-- Logs begin at Fri 2022-05-13 12:12:52 UTC, end at Fri 2022-05-13 13:14:53 UTC. -- May 13 12:39:16.312712 dv-cinder-841644-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 13 12:39:16.320065 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 12:39:16 2022] *** May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: nodename: dv-cinder-841644-1-iscsi May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: machine: x86_64 May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: clock source: unix May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: pcre jit disabled May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: detected number of CPU cores: 4 May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: current working directory: / May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: detected binary path: /usr/bin/uwsgi-core May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: your processes number limit is 47680 May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: your memory page size is 4096 bytes May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: detected max file descriptor number: 2048 May 13 12:39:16.323194 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: lock engine: pthread robust mutexes May 13 12:39:16.323929 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: thunder lock: enabled May 13 12:39:16.323929 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 13 12:39:16.323929 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 12:39:16.370025 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: Python main interpreter initialized at 0x563ffdfd99c0 May 13 12:39:16.370025 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: python threads support enabled May 13 12:39:16.370025 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: your server socket listen backlog is limited to 100 connections May 13 12:39:16.370025 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: your mercy for graceful operations on workers is 90 seconds May 13 12:39:16.370420 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: mapped 403077 bytes (393 KB) for 2 cores May 13 12:39:16.370490 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: *** Operational MODE: preforking *** May 13 12:39:16.370769 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: *** uWSGI is running in multiple interpreter mode *** May 13 12:39:16.370769 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: spawned uWSGI master process (pid: 86328) May 13 12:39:16.370981 dv-cinder-841644-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 13 12:39:16.377285 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: spawned uWSGI worker 1 (pid: 86344, cores: 1) May 13 12:39:16.377285 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: spawned uWSGI worker 2 (pid: 86345, cores: 1) May 13 12:39:16.377285 dv-cinder-841644-1-iscsi devstack@keystone.service[86328]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 12:39:22.243707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:39:22.243707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: from cryptography.utils import int_from_bytes May 13 12:39:22.244444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:39:22.244444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: from cryptography.utils import int_from_bytes May 13 12:39:22.244552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:39:22.244552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: from cryptography.utils import int_from_bytes May 13 12:39:22.244552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 12:39:22.244552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: from cryptography.utils import int_from_bytes May 13 12:39:22.295909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 12:39:22.296115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 12:39:22.296329 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] command line args: [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 12:39:22.296435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 12:39:22.296588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 12:39:22.296669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 12:39:22.296735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ================================================================================ {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 12:39:22.296794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] command line args: [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 12:39:22.296957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] admin_token = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 12:39:22.297219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ================================================================================ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 12:39:22.297298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] config_dir = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] admin_token = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] config_source = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config_dir = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] debug = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.297991 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config_source = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] debug = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.300971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_config_append = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301235 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_config_append = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_dir = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_file = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_dir = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.301989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302936 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.302998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.303523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.304266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.304490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.304663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] publish_errors = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.304894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] publish_errors = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.305116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.305317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.305486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.305678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.305873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.306112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.306281 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.306563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.306753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.306941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.307171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] standard_threads = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.307333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] standard_threads = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.307522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.307710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.307922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.308120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.308351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.308514 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.308708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] use_journal = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.308916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_journal = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.309780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] use_json = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_json = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] use_stderr = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_stderr = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] use_syslog = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_syslog = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.310980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 12:39:22.311116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.311243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.311375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.311501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.311626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.311767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.311903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.312885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.313765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.314916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.315977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.316896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.317979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.318275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.318470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.318619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.318747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.318881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.319893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.320925 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.321988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.322125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.322250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.322383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.322509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.322634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.322764 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.324189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.324388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.324660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.324829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.325185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.325391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.325558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.325917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.325917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.326273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.326462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.326652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.326849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.326849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.327233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.327424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.327424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.327861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.328026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.328026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.328397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.328585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.328585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.328946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329801 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.329928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.330212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.330347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.330487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.330615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.330783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.330923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331302 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.331956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.332892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.333112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.333261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.333400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.333527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.333660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.333806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.334945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.335948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.336853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337682 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.337934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.338969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.339890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.340965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341602 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.341999 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.external = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342787 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.342928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.password = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] auth.token = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.343988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.external = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344779 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.344906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.345132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.password = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.345264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.345480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.token = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.345637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.345769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.345897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346679 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.346941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.347857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348231 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.348900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.349962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.350894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.351876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.352933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.353882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.354025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.354161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.354296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.354426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.354748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.354883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.355792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.356523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.356737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.356915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357798 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.357927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.358981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.359896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.360024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.360152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.360429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.360580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.360720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.360850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361235 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.361900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362155 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.362953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.363871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.364923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.365997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.366896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.367947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.368961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.369889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370143 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.370903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.371039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.371167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.371304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.371431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.371431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.372272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.372405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.372533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.372667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.372806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.372934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.373212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.373344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.373473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.373601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.373739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.373868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374267 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.374913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.375988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.376894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377037 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.377963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.378949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.379997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.380125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.380252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.380379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.380515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.380822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.380956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.381904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] role.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] role.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382815 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.382946 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.383878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.384006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.384134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.384263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.384391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.384768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.384904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.385979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.386221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.386359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.386489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.386617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.386744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.386881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.387958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.388875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.389924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390315 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.390971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.391107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.391236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.391366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.391515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.391769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.391931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.392867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.393989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.394899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.395934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.396072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.396200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.396626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.396767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.396897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.connection = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.397995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398267 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.398919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.399996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.400185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.400320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.400453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.400587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.400801 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.400939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.401913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.402058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.402191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 12:39:22.402326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 12:39:22.402326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86344) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 12:39:22.415724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.416038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.416194 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.416347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.416517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.416829 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.425822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.431842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.455604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.455960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.459807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.460015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.513913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.515249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.569596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.569986 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.574541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.574877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.642379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.642600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.642707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.642828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.643050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.643141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.643271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.643487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.643576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.643895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.644232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.644548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.668172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.668428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.668659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.668827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.668924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.669992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.670200 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.670384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.681846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.682144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.697592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.697914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.698075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.698243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.698393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.698534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.698688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.698838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.699033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.699182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.699328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.699476 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86344) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.699624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.699624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 13 12:39:22.717088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.717426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 12:39:22.717600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.717760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.717906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 12:39:22.718049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 12:39:22.718196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.718337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.718489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 13 12:39:22.718636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.718784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.718944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.719090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.719241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.719387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.719387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.730199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.730487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.730657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.730822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.731617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/<string:protocol_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.731774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/<string:protocol_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.731926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/websso' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.732093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/websso' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.739142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/<string:credential_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.739546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/<string:credential_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.742415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/<string:domain_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.742699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.742857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/<string:domain_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.743098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.743248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.743395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>/<string:option>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.743535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.743696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.743842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/config/<string:group>/<string:option>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.743995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/default' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.744141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.744280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/<string:option>/default' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.744418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/default' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.744572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.744727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/<string:group>/<string:option>/default' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.744873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.745057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.745211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.745362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.745509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.745650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.745650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.773702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.774018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.775275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/<string:endpoint_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.775484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/<string:endpoint_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.775762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints/<string:endpoint_id>/OS-ENDPOINT-POLICY/policy' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.775933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints/<string:endpoint_id>/OS-ENDPOINT-POLICY/policy' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.780950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/<string:group_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.782612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/<string:group_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.782791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.782944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.782944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users/<string:user_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.783252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups/<string:group_id>/users/<string:user_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.790022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/<string:limit_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.790306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.790459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/<string:limit_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.790636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.795201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/<string:endpoint_group_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.795394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/<string:endpoint_group_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.795537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints/<string:endpoint_id>/projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.795693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints/<string:endpoint_id>/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.795840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints/<string:endpoint_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.795979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints/<string:endpoint_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.796118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.796262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoints' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.796415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoint_groups' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.796562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects/<string:project_id>/endpoint_groups' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.796707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/endpoints' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.796846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/endpoints' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.797026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.797192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.797340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects/<string:project_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.797487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups/<string:endpoint_group_id>/projects/<string:project_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.816650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.816961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/auth' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.821738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/<string:idp_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.825394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.825750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers/<string:idp_id>/protocols/<string:protocol_id>/auth' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.825915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.826203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.830397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/<string:idp_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.831136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/<string:mapping_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.834062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols/<string:protocol_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.834360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers/<string:idp_id>/protocols' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.834697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/<string:sp_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.838619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.838911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/inherited_to_projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.839193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.839368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/<string:mapping_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.839579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/inherited_to_projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.839745 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.839977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.843110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/<string:sp_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.846885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.847183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/groups/<string:group_id>/roles/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.847467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.847753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains/<string:domain_id>/users/<string:user_id>/roles/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.848034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.848309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.859265 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/<string:consumer_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.859655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.859921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.860180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/<string:request_token_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.867862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/<string:consumer_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.868105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.868301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.868521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.868784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/<string:request_token_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.869794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.870067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.873871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/<string:policy_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.874142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.874417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints/<string:endpoint_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.874703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.874974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>/regions/<string:region_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.877335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.885326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.885651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.889597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/<string:project_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.890195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/<string:policy_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.890363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.890546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.890708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags/<string:value>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.890860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/endpoints/<string:endpoint_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.891015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.891158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.891304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.891455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies/<string:policy_id>/OS-ENDPOINT-POLICY/services/<string:service_id>/regions/<string:region_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.891595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.891595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.905217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/<string:project_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.905522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.905775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/tags/<string:value>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.906068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.906349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/users/<string:user_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.906632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.906910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects/<string:project_id>/groups/<string:group_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.909635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/<string:region_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.912919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/<string:registered_limit_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.916385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.918011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.920346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/<string:role_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.920619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.920903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies/<string:implied_role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.926175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/<string:region_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.928363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.929531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/<string:registered_limit_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.930168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/<string:service_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.932837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.933397 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.933682 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.933974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.934809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.935705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.938179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/<string:role_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.938179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.938179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles/<string:prior_role_id>/implies/<string:implied_role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.944045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/<string:trust_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.944341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.944618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.945431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.947042 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/<string:service_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.951019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.951315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users/<string:user_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.951604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups/<string:group_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/<string:user_id>] {{(pid=86344) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/password' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/groups' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/projects' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2/<string:credential_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles/<string:role_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials/<string:application_credential_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.957945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules/<string:access_rule_id>' {}] {{(pid=86344) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.961265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/<string:trust_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.961571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.961853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts/<string:trust_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.970744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/<string:user_id>] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 13 12:39:22.971089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/password' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.971307 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/groups' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.971584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.971858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.972150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/credentials/OS-EC2/<string:credential_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.972424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.972701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.973023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.973279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/OS-OAUTH1/access_tokens/<string:access_token_id>/roles/<string:role_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.973552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.973823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/application_credentials/<string:application_credential_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.974095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.974360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users/<string:user_id>/access_rules/<string:access_rule_id>' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 13 12:39:22.997560 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ffdfd99c0 pid: 86344 (default app) May 13 12:39:23.001097 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a4402-11cd-4efb-b164-846783083076 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:23.001399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a4402-11cd-4efb-b164-846783083076 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:23.003495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333a4402-11cd-4efb-b164-846783083076 None None] PATH_INFO: `/v3` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:23.006456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Fri May 13 12:39:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:23.017098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x563ffdfd99c0 pid: 86345 (default app) May 13 12:39:31.368372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c75bb-53bf-48df-a709-82f5c80304ac None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:31.368869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c75bb-53bf-48df-a709-82f5c80304ac None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:31.368869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c75bb-53bf-48df-a709-82f5c80304ac None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:31.370205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:31.378088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:31.378696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:31.378696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:31.410606 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG oslo_db.sqlalchemy.engines [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:39:31.603305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG passlib.handlers.bcrypt [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86345) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 12:39:31.603719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG passlib.handlers.bcrypt [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86345) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 12:39:31.662844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:31.664480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:31.804745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1/3] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 13 12:39:31.966866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c75bb-53bf-48df-a709-82f5c80304ac None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:32.002126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG oslo_db.sqlalchemy.engines [None req-c83c75bb-53bf-48df-a709-82f5c80304ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86344) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 12:39:32.131973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c75bb-53bf-48df-a709-82f5c80304ac None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:32.136502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=htrt5CzRRzCjPTvufVqAwg, audit_chain_id=['htrt5CzRRzCjPTvufVqAwg']) at 0x7fe8a1c72490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:32.137428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:32.137885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:32.138165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:32.146835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:32.200269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING keystone.common.rbac_enforcer.enforcer [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 12:39:32.200598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624fbb14-5dc8-4e40-b37a-6b442876735b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:32.213279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 3/4] 10.222.0.49 () {58 vars in 1324 bytes} [Fri May 13 12:39:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 13 12:39:32.219480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:32.235183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70007c4f-4269-4b19-9c55-07a968a1637c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:32.239597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=htrt5CzRRzCjPTvufVqAwg, audit_chain_id=['htrt5CzRRzCjPTvufVqAwg']) at 0x7fe8a1856fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:32.240733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:32.241205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:32.241701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] PATH_INFO: `/v3/projects/1a91e56fe3d748728a2efec64d71ac50` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:32.244293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] RBAC: Authorizing `identity:get_project(project_id=1a91e56fe3d748728a2efec64d71ac50)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:32.297454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING keystone.common.rbac_enforcer.enforcer [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 13 12:39:32.297843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d403c-df15-447f-8b4e-bdf1801a3d18 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:32.302559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 2/5] 10.222.0.49 () {56 vars in 1207 bytes} [Fri May 13 12:39:32 2022] GET /identity/v3/projects/1a91e56fe3d748728a2efec64d71ac50 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:34.571252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2f2ad-a4dc-4776-86c7-f88d9d6c0d11 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:34.571801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2f2ad-a4dc-4776-86c7-f88d9d6c0d11 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:34.571801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2f2ad-a4dc-4776-86c7-f88d9d6c0d11 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:34.576052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 4/6] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:39:34.582951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:34.583431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:34.583521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:34.604747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:34.606365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:34.615827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 3/7] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 13 12:39:34.641053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2f2ad-a4dc-4776-86c7-f88d9d6c0d11 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:34.653404 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2f2ad-a4dc-4776-86c7-f88d9d6c0d11 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:34.657590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42416a20-6a8b-4232-bcce-e2535f95ccb0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AIMATuGHT3i3c0q77qyfOA, audit_chain_id=['AIMATuGHT3i3c0q77qyfOA']) at 0x7fe8a1968c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:34.658234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416a20-6a8b-4232-bcce-e2535f95ccb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:34.658519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416a20-6a8b-4232-bcce-e2535f95ccb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:34.658795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42416a20-6a8b-4232-bcce-e2535f95ccb0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:34.666922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42416a20-6a8b-4232-bcce-e2535f95ccb0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:34.668912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42416a20-6a8b-4232-bcce-e2535f95ccb0 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:34.677867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 5/8] 10.222.0.49 () {58 vars in 1324 bytes} [Fri May 13 12:39:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 12:39:34.684278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:34.693765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd51617-234e-46da-aef7-f1cd6e352342 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:34.698182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f6053-e2f8-48b9-8c0f-40960dcea5df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=AIMATuGHT3i3c0q77qyfOA, audit_chain_id=['AIMATuGHT3i3c0q77qyfOA']) at 0x7fe8a17f9e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:34.699044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f6053-e2f8-48b9-8c0f-40960dcea5df admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:34.699427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f6053-e2f8-48b9-8c0f-40960dcea5df admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:34.700174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f6053-e2f8-48b9-8c0f-40960dcea5df admin admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:34.701803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f6053-e2f8-48b9-8c0f-40960dcea5df admin admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:34.703642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f6053-e2f8-48b9-8c0f-40960dcea5df admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:34.705298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 4/9] 10.222.0.49 () {56 vars in 1198 bytes} [Fri May 13 12:39:34 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:37.059679 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baad04-2d86-4ee9-9fdd-a41b7bafb77f None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.060195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baad04-2d86-4ee9-9fdd-a41b7bafb77f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.060276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baad04-2d86-4ee9-9fdd-a41b7bafb77f None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.061670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:37.067292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.067768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.067930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.094519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed079-404e-467f-aaf2-2b2db7175b91 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.094805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed079-404e-467f-aaf2-2b2db7175b91 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.095081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aed079-404e-467f-aaf2-2b2db7175b91 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.096517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 7/11] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:39:37.106178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.106597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.106796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.159520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG passlib.handlers.bcrypt [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86344) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 13 12:39:37.159945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG passlib.handlers.bcrypt [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86344) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 13 12:39:37.207630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:37.207899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:37.209129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:37.209277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:37.294296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 5/12] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:37.313196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 8/13] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:37.317722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.336053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.423311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835eb0e-7aad-4cdc-8d17-045463786a49 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:37.439476 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f99977-27a0-4fae-9340-b9862c9e1e5e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:37.458515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=laJwh1oBRGWiCkPO-hQsbw, audit_chain_id=['laJwh1oBRGWiCkPO-hQsbw']) at 0x7fe8a19f9d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:37.459318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.459604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.459879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.471303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:37.472674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5AUO6f_bQb6SV6cHeY69AA, audit_chain_id=['5AUO6f_bQb6SV6cHeY69AA']) at 0x7fe8a191d460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:37.473614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.473897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.474403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:37.483306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:37.484406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:37.485387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:39:37.489154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 6/14] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:37.490491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.546569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:37.548341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:37.594271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87794731-f4a7-4871-b30b-a3a9508fab95 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:37.631372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=laJwh1oBRGWiCkPO-hQsbw, audit_chain_id=['laJwh1oBRGWiCkPO-hQsbw']) at 0x7fe8a18455e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:37.632039 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.632321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.632596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.633391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:37.633693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:37.635361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:37.647612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 7/15] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:37.654103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 9/16] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 12:39:37.656455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.659634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.769400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202fa4f-cc21-4b73-9a4e-0fab0cb198cf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:37.809706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=laJwh1oBRGWiCkPO-hQsbw, audit_chain_id=['laJwh1oBRGWiCkPO-hQsbw']) at 0x7fe8a1845bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:37.810498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.810774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.812270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:37.813749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:37.815402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 8/17] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:37.822241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.875240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de17374e-8143-4a85-a6e8-29153842c980 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:37.910041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5AUO6f_bQb6SV6cHeY69AA, audit_chain_id=['5AUO6f_bQb6SV6cHeY69AA']) at 0x7fe8a18629a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:37.911095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.911385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.911659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.934080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:37.936075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:37.941282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16de9d-08ad-442c-a0cd-e7b52abb8bcb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:39:37.957838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:37.958815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:37.959597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:39:37.959597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:39:37.959597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:39:37.959597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:37.959597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 10/18] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:39:37.969139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:37.976739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=laJwh1oBRGWiCkPO-hQsbw, audit_chain_id=['laJwh1oBRGWiCkPO-hQsbw']) at 0x7fe8a17d67f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:37.977577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:37.977857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:37.978131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:37.979326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:37.980823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:37.982523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 9/19] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:37.988167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:38.072189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd7b0d8-5237-4dac-ac7a-72295eeaafc4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:38.091564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683fce1-3bc1-49c4-a728-2ad9ba20287c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:38.108070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5AUO6f_bQb6SV6cHeY69AA, audit_chain_id=['5AUO6f_bQb6SV6cHeY69AA']) at 0x7fe8a199b370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:38.108733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:38.109042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:38.109349 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:38.110079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:38.110377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:38.111779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ad3b-f6cd-4140-892c-5f4ead8006cf None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:38.129670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:38.131617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=laJwh1oBRGWiCkPO-hQsbw, audit_chain_id=['laJwh1oBRGWiCkPO-hQsbw']) at 0x7fe8a1841820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:38.132639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:38.133164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:38.133639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:38.135428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.domain.id=default, user.id=94afba6895414851b5641f8db5e9fdde) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:38.135886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:38.138972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93e35d8-0bc5-488e-9641-d12020752bb5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:38.151017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1322 bytes} [Fri May 13 12:39:37 2022] GET /identity/v3/role_assignments?user.id=94afba6895414851b5641f8db5e9fdde&scope.domain.id=default&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:41.302988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ab06-9203-4e64-954d-dd5845a74090 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.305681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e38d3-359b-4704-bf07-ffd343c64430 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.306350 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ab06-9203-4e64-954d-dd5845a74090 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.306874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e38d3-359b-4704-bf07-ffd343c64430 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.307373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ab06-9203-4e64-954d-dd5845a74090 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.307842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775e38d3-359b-4704-bf07-ffd343c64430 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.312447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 11/22] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:41.312935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 12/23] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:41.316118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595454c6-7968-4901-ac02-df5096f82520 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.316401 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595454c6-7968-4901-ac02-df5096f82520 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.316674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595454c6-7968-4901-ac02-df5096f82520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.318326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.318864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.319387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.339353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-595454c6-7968-4901-ac02-df5096f82520 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:41.342170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-595454c6-7968-4901-ac02-df5096f82520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:41.351259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:41.353768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:41.414688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 12/24] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:41.436976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595454c6-7968-4901-ac02-df5096f82520 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:41.439131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 13/25] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:41.477257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:41.541784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595454c6-7968-4901-ac02-df5096f82520 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:41.587067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DaOTGXeSSSyxsvDlNmsAqg, audit_chain_id=['DaOTGXeSSSyxsvDlNmsAqg']) at 0x7fe8a18c5fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:41.588829 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.589490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.590922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.619974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:41.632885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:41.633886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:41.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:39:41.638086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 13/26] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:41.643661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:41.692130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b49294-745b-4e33-b4e0-5aa4d5b56d62 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:41.771924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3xQuy3EbS2uGPQBCc4opbg, audit_chain_id=['3xQuy3EbS2uGPQBCc4opbg']) at 0x7fe8a1f5fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:41.773300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.773809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.774279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.794533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:41.796396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:39:41.831376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:41.832215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:41.833004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:39:41.833004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:39:41.833004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:39:41.833004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:41.835629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 14/27] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:41.842460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:41.911154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163e06-1df7-4ad4-8da9-3d0c6f083165 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:41.986263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DaOTGXeSSSyxsvDlNmsAqg, audit_chain_id=['DaOTGXeSSSyxsvDlNmsAqg']) at 0x7fe8a1790520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:41.986953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:41.987234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:41.987508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:41.988274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:41.988582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:41.990029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b8cd80-f7f3-4c43-9934-c9c0fece1314 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.004326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 14/28] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:42.005731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72744ae-cf54-4e97-8b0c-46cd86eb42a2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.006025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72744ae-cf54-4e97-8b0c-46cd86eb42a2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.006307 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72744ae-cf54-4e97-8b0c-46cd86eb42a2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.009900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 15/29] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:42.015367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72744ae-cf54-4e97-8b0c-46cd86eb42a2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:42.037702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e1997-7519-40aa-a157-ba69b86068d7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.082485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3xQuy3EbS2uGPQBCc4opbg, audit_chain_id=['3xQuy3EbS2uGPQBCc4opbg']) at 0x7fe8a18334f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:42.083435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.083864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.084341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.085294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:42.085767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:42.087399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d468677f-9c12-4ff0-975a-6061030881ca None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.101055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 15/30] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:42.102811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bc78b-d7a5-4e59-86d5-3238499a5d77 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.103312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bc78b-d7a5-4e59-86d5-3238499a5d77 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.103785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bc78b-d7a5-4e59-86d5-3238499a5d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.125468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-206bc78b-d7a5-4e59-86d5-3238499a5d77 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:42.127817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-206bc78b-d7a5-4e59-86d5-3238499a5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:42.156225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72744ae-cf54-4e97-8b0c-46cd86eb42a2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.203371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DaOTGXeSSSyxsvDlNmsAqg, audit_chain_id=['DaOTGXeSSSyxsvDlNmsAqg']) at 0x7fe8a1841220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:42.204646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.205198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.205671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.207328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:42.209146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.210518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 16/31] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:42.212074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253683e3-c35b-4668-be11-56016f2c3cf9 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.212432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 16/32] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:42 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:42.217734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253683e3-c35b-4668-be11-56016f2c3cf9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.217734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253683e3-c35b-4668-be11-56016f2c3cf9 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.218912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 17/33] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:42.219164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:42.219697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253683e3-c35b-4668-be11-56016f2c3cf9 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:42.348300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253683e3-c35b-4668-be11-56016f2c3cf9 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.349628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389e37e-f8ec-4666-8f0a-da6d907e4f1c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.387238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a0340-6f61-452d-8c49-542c6c2b6456 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DaOTGXeSSSyxsvDlNmsAqg, audit_chain_id=['DaOTGXeSSSyxsvDlNmsAqg']) at 0x7fe8a1a03f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:42.387892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3xQuy3EbS2uGPQBCc4opbg, audit_chain_id=['3xQuy3EbS2uGPQBCc4opbg']) at 0x7fe8a1868250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:42.389087 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a0340-6f61-452d-8c49-542c6c2b6456 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.389402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a0340-6f61-452d-8c49-542c6c2b6456 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.389676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a0340-6f61-452d-8c49-542c6c2b6456 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.389996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.390475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.390942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.391174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a0340-6f61-452d-8c49-542c6c2b6456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:42.392081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:42.392643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a0340-6f61-452d-8c49-542c6c2b6456 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.394029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.399161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 18/34] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:42.400603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.400889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.401230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.421612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:42.421796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:42.501009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 19/35] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:42.501009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:42.573918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 17/36] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:39:42 2022] POST /identity/v3/projects => generated 301 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:42.576395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:42.613941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb61b348-e412-4f48-a1b1-a99ac79dd145 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.661293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da593278-61cb-4a56-8b8b-9176806a7563 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oP_ByRNKSP-H7LthIFJyVA, audit_chain_id=['oP_ByRNKSP-H7LthIFJyVA']) at 0x7fe8a36ba9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:42.662707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da593278-61cb-4a56-8b8b-9176806a7563 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.663434 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da593278-61cb-4a56-8b8b-9176806a7563 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.663979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da593278-61cb-4a56-8b8b-9176806a7563 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.664755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da593278-61cb-4a56-8b8b-9176806a7563 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:42.666208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da593278-61cb-4a56-8b8b-9176806a7563 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.701650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f6f6b-f76b-4e39-b75d-2b450dac6a0e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.750440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DaOTGXeSSSyxsvDlNmsAqg, audit_chain_id=['DaOTGXeSSSyxsvDlNmsAqg']) at 0x7fe8a1834610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:42.751700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.752243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.752720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] PATH_INFO: `/v3/domains/default/users/94afba6895414851b5641f8db5e9fdde/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.757953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=94afba6895414851b5641f8db5e9fdde, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:42.760169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:42.786497 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 18/37] 10.222.0.49 () {58 vars in 1361 bytes} [Fri May 13 12:39:42 2022] PUT /identity/v3/domains/default/users/94afba6895414851b5641f8db5e9fdde/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:39:42.787504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:42.826980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 20/38] 10.222.0.49 () {60 vars in 1131 bytes} [Fri May 13 12:39:42 2022] POST /identity/v3/roles => generated 225 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:42.828617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbc999-6eb7-421c-b104-b474da8377df None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.828907 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbc999-6eb7-421c-b104-b474da8377df None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.829230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bbc999-6eb7-421c-b104-b474da8377df None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.830649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 21/39] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:42.837055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:42.837361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:42.837626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:42.861861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:42.863539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:42.943882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74573495-ae6b-498e-b2f6-f8e3c278401a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:42.989241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 22/40] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:43.010840 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199afb9-e39d-4a14-8605-824e0b251d4b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ak0grW2jQeebhAJ9ljfkeg, audit_chain_id=['ak0grW2jQeebhAJ9ljfkeg']) at 0x7fe8a18c5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:43.011552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199afb9-e39d-4a14-8605-824e0b251d4b None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:43.011886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199afb9-e39d-4a14-8605-824e0b251d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:43.012216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199afb9-e39d-4a14-8605-824e0b251d4b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:43.013536 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199afb9-e39d-4a14-8605-824e0b251d4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:43.014517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:43.015109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199afb9-e39d-4a14-8605-824e0b251d4b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:43.075374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 19/41] 10.222.0.49 () {60 vars in 1131 bytes} [Fri May 13 12:39:42 2022] POST /identity/v3/roles => generated 219 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:43.204967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971401d0-2bdb-4f3b-aaf3-21b0afb9cfa9 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:43.239346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68309-38e4-4a44-ab82-444d71ea8b2a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:43.239686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68309-38e4-4a44-ab82-444d71ea8b2a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:43.240026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68309-38e4-4a44-ab82-444d71ea8b2a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:43.241822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 20/42] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:43.248595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:43.248884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:43.249213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:43.256669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=2rlRlQwmQcKbPCDOroLaLg, audit_chain_id=['2rlRlQwmQcKbPCDOroLaLg']) at 0x7fe8a19b6610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:43.257637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:43.258062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:43.258640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:43.260486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:43.263631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:43.274338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:43.275001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:43.284187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 23/43] 10.222.0.49 () {60 vars in 1131 bytes} [Fri May 13 12:39:43 2022] POST /identity/v3/roles => generated 223 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:39:43.370759 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 21/44] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:43.396039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:43.511017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f68b9c-8489-4506-8ffc-1dd2356963a1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:43.550819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf7c26-7db5-474d-a493-5a88d3067f90 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=94_w7VKNTKePd5MS6ywcOw, audit_chain_id=['94_w7VKNTKePd5MS6ywcOw']) at 0x7fe8a1604e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:43.551622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7c26-7db5-474d-a493-5a88d3067f90 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:43.551910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7c26-7db5-474d-a493-5a88d3067f90 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:43.552186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf7c26-7db5-474d-a493-5a88d3067f90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:43.553425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf7c26-7db5-474d-a493-5a88d3067f90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:43.554898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf7c26-7db5-474d-a493-5a88d3067f90 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:43.556829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 24/45] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:43.562563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:43.665432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13dd3e6-62bb-445f-b365-92cc9a4f1565 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:43.700857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a26b91-fa60-48e7-beaa-3f293e67448c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=94_w7VKNTKePd5MS6ywcOw, audit_chain_id=['94_w7VKNTKePd5MS6ywcOw']) at 0x7fe8a182c220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:43.701556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26b91-fa60-48e7-beaa-3f293e67448c None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:43.701842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26b91-fa60-48e7-beaa-3f293e67448c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:43.702122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a26b91-fa60-48e7-beaa-3f293e67448c None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:43.702851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26b91-fa60-48e7-beaa-3f293e67448c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:43.704313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a26b91-fa60-48e7-beaa-3f293e67448c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:43.730559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 22/46] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:39:43 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:45.313539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560756-1cb9-46f3-8136-69afc276db65 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:45.314026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560756-1cb9-46f3-8136-69afc276db65 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:45.314026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac560756-1cb9-46f3-8136-69afc276db65 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:45.315414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 25/47] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:45.320952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:45.321389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:45.321550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:45.338969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:45.340793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:45.411340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 23/48] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:45.434140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560756-1cb9-46f3-8136-69afc276db65 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:45.540266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac560756-1cb9-46f3-8136-69afc276db65 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:45.577602 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ej_40XIsS8uoso0zG5CXuQ, audit_chain_id=['ej_40XIsS8uoso0zG5CXuQ']) at 0x7fe8a25eed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:45.578333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:45.578614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:45.578886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:45.598849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:45.607733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:45.608886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:45.609899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 26/49] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:45.614888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:45.711852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb3477-f91c-4294-b79b-4f317849273f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:45.756701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ej_40XIsS8uoso0zG5CXuQ, audit_chain_id=['ej_40XIsS8uoso0zG5CXuQ']) at 0x7fe8a1838820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:45.757410 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:45.757693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:45.757962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:45.758771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:45.759071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:45.760708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:45.769648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 24/50] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:45.775123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:45.882684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11095f1c-8bff-426c-b5ca-675c0b1a47ae None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:45.919616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be5e5a-967c-4a92-b9fa-5020613cc660 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ej_40XIsS8uoso0zG5CXuQ, audit_chain_id=['ej_40XIsS8uoso0zG5CXuQ']) at 0x7fe8a160e790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:45.920499 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5e5a-967c-4a92-b9fa-5020613cc660 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:45.920779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5e5a-967c-4a92-b9fa-5020613cc660 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:45.921084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be5e5a-967c-4a92-b9fa-5020613cc660 None admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:45.922543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5e5a-967c-4a92-b9fa-5020613cc660 None admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:45.923994 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be5e5a-967c-4a92-b9fa-5020613cc660 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:45.925684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 27/51] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:45 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:45.931393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:46.022795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae4239-0180-438b-befa-6ea61e573249 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:46.023081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae4239-0180-438b-befa-6ea61e573249 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:46.023353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae4239-0180-438b-befa-6ea61e573249 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:46.024812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 28/52] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:46.030894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:46.031180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:46.031458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:46.047080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4b1cc-b789-4746-a47d-8bd004c55fd0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:46.049287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:46.050496 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:46.079994 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ej_40XIsS8uoso0zG5CXuQ, audit_chain_id=['ej_40XIsS8uoso0zG5CXuQ']) at 0x7fe8a1532f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:46.080789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:46.081107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:46.081385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:46.082562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:46.084018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:46.085892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 25/53] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:46.092095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:46.120345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 29/54] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:46.144207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:46.199578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f282dd70-21e5-4496-8c3e-7186ef5fc85c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:46.233147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ej_40XIsS8uoso0zG5CXuQ, audit_chain_id=['ej_40XIsS8uoso0zG5CXuQ']) at 0x7fe8a1838b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:46.233766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:46.234044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:46.234317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:46.235171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.domain.id=default, user.id=94afba6895414851b5641f8db5e9fdde) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:46.235461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:46.236900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:46.244107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 26/55] 10.222.0.49 () {56 vars in 1322 bytes} [Fri May 13 12:39:46 2022] GET /identity/v3/role_assignments?user.id=94afba6895414851b5641f8db5e9fdde&scope.domain.id=default&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:46.249252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11864144-505d-4fde-8203-7a143eb02bcc None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:46.289932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a50e31-4da6-4802-886a-62333491379b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aeqP3PW-QJibZbXC3KBomQ, audit_chain_id=['aeqP3PW-QJibZbXC3KBomQ']) at 0x7fe8a15fd0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:46.290756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50e31-4da6-4802-886a-62333491379b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:46.291041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50e31-4da6-4802-886a-62333491379b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:46.291317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a50e31-4da6-4802-886a-62333491379b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:46.292598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50e31-4da6-4802-886a-62333491379b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:46.294233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a50e31-4da6-4802-886a-62333491379b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:46.295941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 30/56] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:46.301667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:46.415339 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7aa25-90b4-422a-8163-dcacfaab661b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:46.451392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a55b44-93e1-4d12-88fd-6092b6439cc0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aeqP3PW-QJibZbXC3KBomQ, audit_chain_id=['aeqP3PW-QJibZbXC3KBomQ']) at 0x7fe8a15be940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:46.452076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a55b44-93e1-4d12-88fd-6092b6439cc0 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:46.452364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a55b44-93e1-4d12-88fd-6092b6439cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:46.452645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a55b44-93e1-4d12-88fd-6092b6439cc0 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:46.453399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a55b44-93e1-4d12-88fd-6092b6439cc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:46.454851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a55b44-93e1-4d12-88fd-6092b6439cc0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:46.486079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 27/57] 10.222.0.49 () {60 vars in 1140 bytes} [Fri May 13 12:39:46 2022] POST /identity/v3/projects => generated 298 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:48.753667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320671bc-3ddf-48ca-98af-2e427f0e3282 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:48.754214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320671bc-3ddf-48ca-98af-2e427f0e3282 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:48.754214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320671bc-3ddf-48ca-98af-2e427f0e3282 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:48.755603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 31/58] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:48.761354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:48.761828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:48.761956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:48.779402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:48.780624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:48.846430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 28/59] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:48.871932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320671bc-3ddf-48ca-98af-2e427f0e3282 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:48.971341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320671bc-3ddf-48ca-98af-2e427f0e3282 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:49.006330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0735c-7046-4f8b-b6a2-41b5d05691ad None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BPQiSAgdROOaYd2ir1ztIA, audit_chain_id=['BPQiSAgdROOaYd2ir1ztIA']) at 0x7fe8a1557fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:49.007033 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0735c-7046-4f8b-b6a2-41b5d05691ad None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:49.007313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0735c-7046-4f8b-b6a2-41b5d05691ad None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:49.007588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0735c-7046-4f8b-b6a2-41b5d05691ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:49.008847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0735c-7046-4f8b-b6a2-41b5d05691ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:49.010593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0735c-7046-4f8b-b6a2-41b5d05691ad None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:49.012592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 32/60] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:49.022036 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:49.116229 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cc2c20-e3eb-4ec2-84e3-433f7dd7c5c1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:49.150718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f443cf86-f83e-460b-9c20-801a51b592b2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BPQiSAgdROOaYd2ir1ztIA, audit_chain_id=['BPQiSAgdROOaYd2ir1ztIA']) at 0x7fe8a1541910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:49.151387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443cf86-f83e-460b-9c20-801a51b592b2 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:49.151670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443cf86-f83e-460b-9c20-801a51b592b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:49.151942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f443cf86-f83e-460b-9c20-801a51b592b2 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:49.152872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443cf86-f83e-460b-9c20-801a51b592b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:49.154352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f443cf86-f83e-460b-9c20-801a51b592b2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:49.179789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 29/61] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:39:49 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:52.552593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd52d-d057-4b85-8f95-87ac29bb5090 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:52.553618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd52d-d057-4b85-8f95-87ac29bb5090 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:52.554101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dd52d-d057-4b85-8f95-87ac29bb5090 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:52.555973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 33/62] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:52.562378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227ceb-63e2-48bb-ba0d-5d050a5a1b9b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:52.563333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227ceb-63e2-48bb-ba0d-5d050a5a1b9b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:52.563807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3227ceb-63e2-48bb-ba0d-5d050a5a1b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:52.582410 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a3227ceb-63e2-48bb-ba0d-5d050a5a1b9b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:52.584037 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a3227ceb-63e2-48bb-ba0d-5d050a5a1b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:52.679710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 30/63] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:52.726543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd52d-d057-4b85-8f95-87ac29bb5090 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:52.869823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dd52d-d057-4b85-8f95-87ac29bb5090 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:52.916468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gq-W6obvQumebZF_ST4D7g, audit_chain_id=['gq-W6obvQumebZF_ST4D7g']) at 0x7fe8a160ad90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:52.918336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:52.920562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defa14-460c-4044-b186-20581ea9e9b2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:52.921183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defa14-460c-4044-b186-20581ea9e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:52.921675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0defa14-460c-4044-b186-20581ea9e9b2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:52.923368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 31/64] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:39:52.923825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:52.924419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:52.929731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934d87b-660e-423a-b7cf-0f02fa6dcc19 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:52.930354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934d87b-660e-423a-b7cf-0f02fa6dcc19 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:52.930826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934d87b-660e-423a-b7cf-0f02fa6dcc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:52.950745 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:52.950932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f934d87b-660e-423a-b7cf-0f02fa6dcc19 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:52.952403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f934d87b-660e-423a-b7cf-0f02fa6dcc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:52.958500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:52.959386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:52.965320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 34/65] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:52.974931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.061098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 32/66] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:53.062903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6783-fa7c-4580-a5a1-688376d83326 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.065228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6783-fa7c-4580-a5a1-688376d83326 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.066770 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e6783-fa7c-4580-a5a1-688376d83326 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.068325 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 33/67] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:53.078776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6652-9c64-4be0-a94f-50691dc44c61 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.079278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6652-9c64-4be0-a94f-50691dc44c61 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.080617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42de6652-9c64-4be0-a94f-50691dc44c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.101657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b6643-5987-4427-bfc6-9e66a34e4765 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.106226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-42de6652-9c64-4be0-a94f-50691dc44c61 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:53.107674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-42de6652-9c64-4be0-a94f-50691dc44c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:53.141510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gq-W6obvQumebZF_ST4D7g, audit_chain_id=['gq-W6obvQumebZF_ST4D7g']) at 0x7fe8a15ff040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.142191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.142475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.142749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.143502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:53.143809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.145239 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.159739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 35/68] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:39:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:53.160934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.199118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 34/69] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:53.200819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275a6d-6e76-450d-a132-9d8688751982 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.201144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275a6d-6e76-450d-a132-9d8688751982 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.201422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc275a6d-6e76-450d-a132-9d8688751982 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.202919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 35/70] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:53.207504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc275a6d-6e76-450d-a132-9d8688751982 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.285691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5918a-1f09-4c21-9322-d5150a32ab77 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.318982 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc275a6d-6e76-450d-a132-9d8688751982 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.328233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c07768-faa0-4439-8f1c-1f5678c72983 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8WJ3fXrRaqCvtAlIP8Wqw, audit_chain_id=['r8WJ3fXrRaqCvtAlIP8Wqw']) at 0x7fe8a15f6b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.329092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07768-faa0-4439-8f1c-1f5678c72983 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.329440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07768-faa0-4439-8f1c-1f5678c72983 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.329726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c07768-faa0-4439-8f1c-1f5678c72983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.344556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c07768-faa0-4439-8f1c-1f5678c72983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-57c07768-faa0-4439-8f1c-1f5678c72983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:53.352185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:53.353290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:53.354179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 36/71] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:53.357776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gq-W6obvQumebZF_ST4D7g, audit_chain_id=['gq-W6obvQumebZF_ST4D7g']) at 0x7fe8a1532f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.358660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.358943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.359219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.359491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbff727-113c-449b-ad30-ad444fa3b59c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.359782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbff727-113c-449b-ad30-ad444fa3b59c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.360063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbff727-113c-449b-ad30-ad444fa3b59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.373772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.375261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.377009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 36/72] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:53.377964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.378297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4fbff727-113c-449b-ad30-ad444fa3b59c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:53.379440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4fbff727-113c-449b-ad30-ad444fa3b59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:53.446632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 37/73] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:53.447936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d37d0-67d5-42d0-a028-4718ae3ab81b None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.448228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d37d0-67d5-42d0-a028-4718ae3ab81b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.448503 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3d37d0-67d5-42d0-a028-4718ae3ab81b None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.454577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 38/74] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:53.454577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d37d0-67d5-42d0-a028-4718ae3ab81b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.483056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8b6b1-5071-4acc-87af-ceb07ab35aa1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.516480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3dsx-anMTDmIaINpfOI2pw, audit_chain_id=['3dsx-anMTDmIaINpfOI2pw']) at 0x7fe8a17f0070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.517309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.517592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.517862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.527613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:53.535739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:53.536853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:53.537731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.550973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3d37d0-67d5-42d0-a028-4718ae3ab81b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.583772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8WJ3fXrRaqCvtAlIP8Wqw, audit_chain_id=['r8WJ3fXrRaqCvtAlIP8Wqw']) at 0x7fe8a15df9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.584450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.584739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.585041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.585794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:53.586104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.587491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48521214-464f-4e79-ba69-b87064a5436d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.595825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 39/76] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:53.598220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.598516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.598855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.614830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:53.616019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:53.633947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc6e527-e697-4582-a535-f0d3e4a2c3f5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.665955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gq-W6obvQumebZF_ST4D7g, audit_chain_id=['gq-W6obvQumebZF_ST4D7g']) at 0x7fe8a1549790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.666593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.666874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.667148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.679308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 40/77] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:53.680141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.732645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.734076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.774165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad6731-aee8-400c-83c6-34ba2e36c8d1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.806438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5TW6hj-_QtWquwxz353LBg, audit_chain_id=['5TW6hj-_QtWquwxz353LBg']) at 0x7fe8a15df550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.807228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.807508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.807783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.809184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.810629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.812266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 41/78] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:53.813153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.837614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 38/79] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:39:53.838477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.912400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e3499-5104-47ce-bfab-cf617330c527 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.934356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1d586-2189-4757-b74d-c38d9b1909ec None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:53.945039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3dsx-anMTDmIaINpfOI2pw, audit_chain_id=['3dsx-anMTDmIaINpfOI2pw']) at 0x7fe8a1862910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.945708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.945989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.946263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.947008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:53.947310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.948688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.957454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 42/80] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:53.958238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:53.970452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8WJ3fXrRaqCvtAlIP8Wqw, audit_chain_id=['r8WJ3fXrRaqCvtAlIP8Wqw']) at 0x7fe8a153b520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:53.971336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:53.971617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:53.971890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:53.973205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:53.974720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:53.976518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 39/81] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:53.977149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.054878 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a0fe-0c0b-40ba-8307-39e76605f11f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.072134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b18dba-7037-4c01-90e5-b4fc46873081 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.090583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sER8eEipSiy11iqBADTWzA, audit_chain_id=['sER8eEipSiy11iqBADTWzA']) at 0x7fe8a15574c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.091371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.091655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.091930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.101680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:54.106741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5TW6hj-_QtWquwxz353LBg, audit_chain_id=['5TW6hj-_QtWquwxz353LBg']) at 0x7fe8a15258e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.107381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.107662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.107940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.108639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:54.109241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:54.110199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:54.110927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:54.111492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.111568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 43/82] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:54.111568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.131881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 40/83] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:39:53 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:54.132861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.251075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e19e53-4bd3-45e8-840b-c0db5f240984 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.266580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59f0cd-a4a3-4b94-adf3-02130b1388fd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.291789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3dsx-anMTDmIaINpfOI2pw, audit_chain_id=['3dsx-anMTDmIaINpfOI2pw']) at 0x7fe8a15bea00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.292678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.293607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.293884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.295313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.296782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.298665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 41/84] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:54.299367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.310338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gq-W6obvQumebZF_ST4D7g, audit_chain_id=['gq-W6obvQumebZF_ST4D7g']) at 0x7fe8a1573250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.311127 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.311412 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.311688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.313450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.314670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.316721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 44/85] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:54.317177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.404655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6f40f-89b7-4d1b-b978-4ac125684d09 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.422978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8683e5-e2b7-494d-bd84-246b0a3aad45 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.442665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8WJ3fXrRaqCvtAlIP8Wqw, audit_chain_id=['r8WJ3fXrRaqCvtAlIP8Wqw']) at 0x7fe8a151d760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.443671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.444084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.444358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.466587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sER8eEipSiy11iqBADTWzA, audit_chain_id=['sER8eEipSiy11iqBADTWzA']) at 0x7fe8a155a3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.466587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.466587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.466922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.467459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:54.467768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.469286 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.478101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 45/86] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:54.479219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.515741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.517254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.580612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0e7e3-315b-415d-a804-fd31ce631c3b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.615016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3dsx-anMTDmIaINpfOI2pw, audit_chain_id=['3dsx-anMTDmIaINpfOI2pw']) at 0x7fe8a160ed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.615753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.615975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.616243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.617669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 42/87] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:39:54.622968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.685246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.686716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.726215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94897744-46dc-4696-8165-07dd705034d7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.760773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gq-W6obvQumebZF_ST4D7g, audit_chain_id=['gq-W6obvQumebZF_ST4D7g']) at 0x7fe8a15239d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.762055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.762493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.762817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.763803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=bb55de117ea24c3f87df0a228e17033a) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:54.764109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.765568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.771233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 43/88] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/role_assignments?user.id=bb55de117ea24c3f87df0a228e17033a&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:54.772127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.792385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 46/89] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:39:54.793140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.887721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac361c8-547a-46ae-9ca9-beb67db03811 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.898013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d546e8b-4b67-45c8-9ee2-ac0ff900ee92 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:54.924397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sER8eEipSiy11iqBADTWzA, audit_chain_id=['sER8eEipSiy11iqBADTWzA']) at 0x7fe8a1526fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.925308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.925586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.925895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.927279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.928768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.930684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 44/90] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:54.931384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:54.934484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8WJ3fXrRaqCvtAlIP8Wqw, audit_chain_id=['r8WJ3fXrRaqCvtAlIP8Wqw']) at 0x7fe8a15f6f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:54.935414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:54.935699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:54.935975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:54.937257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:54.938746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:54.940710 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 47/91] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:54.941371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:55.045917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae53aa1-0e70-43ee-9223-25921157dd56 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:55.053042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bccfd7a-19d8-49b1-9a98-3569b5658cdf None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:55.082815 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3dsx-anMTDmIaINpfOI2pw, audit_chain_id=['3dsx-anMTDmIaINpfOI2pw']) at 0x7fe8a15be8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:55.083823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:55.084104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:55.084375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:55.085661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:55.087027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:55.088719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:55.090250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:55.091772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sER8eEipSiy11iqBADTWzA, audit_chain_id=['sER8eEipSiy11iqBADTWzA']) at 0x7fe8a15fc250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:55.092666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:55.093182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:55.093635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:55.167881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:55.169808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:55.195109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162568f-9057-4bb4-8cd9-bdd29e0c4af7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:55.231717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8WJ3fXrRaqCvtAlIP8Wqw, audit_chain_id=['r8WJ3fXrRaqCvtAlIP8Wqw']) at 0x7fe8a1549100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:55.232347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:55.232629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:55.232915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:55.233784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=94afba6895414851b5641f8db5e9fdde) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:55.234092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:55.235528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:55.241540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 46/93] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:39:55 2022] GET /identity/v3/role_assignments?user.id=94afba6895414851b5641f8db5e9fdde&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:55.246045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:55.285810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 48/94] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:39:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:39:55.293590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:55.440942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d7113-ef8b-40f8-a0f7-469c88591e83 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:55.503962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3dsx-anMTDmIaINpfOI2pw, audit_chain_id=['3dsx-anMTDmIaINpfOI2pw']) at 0x7fe8a1526fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:55.505304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:55.505801 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:55.506276 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:55.507547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] RBAC: Adding query filter params (role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=bb55de117ea24c3f87df0a228e17033a) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:55.508097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:55.509487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14541098-e143-4ba9-bfac-632d83602a87 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:55.510347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:55.523136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 47/95] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:39:55 2022] GET /identity/v3/role_assignments?user.id=bb55de117ea24c3f87df0a228e17033a&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:55.570672 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4352f-4ee1-4560-8f4b-507857ac7304 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sER8eEipSiy11iqBADTWzA, audit_chain_id=['sER8eEipSiy11iqBADTWzA']) at 0x7fe8a160cf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:55.571565 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4352f-4ee1-4560-8f4b-507857ac7304 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:55.571846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4352f-4ee1-4560-8f4b-507857ac7304 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:55.572121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4352f-4ee1-4560-8f4b-507857ac7304 None admin] PATH_INFO: `/v3/projects/13d71a65689441049a3427e4913aa4bd` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:55.573461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4352f-4ee1-4560-8f4b-507857ac7304 None admin] RBAC: Authorizing `identity:get_project(project_id=13d71a65689441049a3427e4913aa4bd)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:55.575523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4352f-4ee1-4560-8f4b-507857ac7304 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:55.582417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 49/96] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:39:55 2022] GET /identity/v3/projects/13d71a65689441049a3427e4913aa4bd => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:55.583425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:55.693379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d125e-ece3-4db9-832d-e3995878488f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:55.729124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sER8eEipSiy11iqBADTWzA, audit_chain_id=['sER8eEipSiy11iqBADTWzA']) at 0x7fe8a1532ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:55.729764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:55.730052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:55.731005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:55.731923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=13d71a65689441049a3427e4913aa4bd, user.id=bb55de117ea24c3f87df0a228e17033a) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:55.732232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:55.733709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39634460-c48f-4cef-a652-1217e1691ef3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:55.739729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 48/97] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:39:55 2022] GET /identity/v3/role_assignments?user.id=bb55de117ea24c3f87df0a228e17033a&scope.project.id=13d71a65689441049a3427e4913aa4bd&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:57.114887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9f92-0ba1-405b-be9a-feda9ce6726d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:57.116209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9f92-0ba1-405b-be9a-feda9ce6726d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:57.116955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9f92-0ba1-405b-be9a-feda9ce6726d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:57.119683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 50/98] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:57.129185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:57.131114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:57.131636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:57.153686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:57.155556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:57.259685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 49/99] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:57.284374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9f92-0ba1-405b-be9a-feda9ce6726d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:57.405284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9f92-0ba1-405b-be9a-feda9ce6726d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:57.443177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-a0w49bNS_i7KOZF86DaCQ, audit_chain_id=['-a0w49bNS_i7KOZF86DaCQ']) at 0x7fe8a1604a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:57.444364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:57.444854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:57.445354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:57.464043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:57.472440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:57.474075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:39:57.475540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 51/100] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:39:57.486286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:57.677531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7bf54-ebac-40dd-a1dd-878bb027dabe None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:57.741771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-a0w49bNS_i7KOZF86DaCQ, audit_chain_id=['-a0w49bNS_i7KOZF86DaCQ']) at 0x7fe8a181cf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:57.743348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:57.744199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:57.744948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:57.746797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:57.747629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:57.750575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:57.767815 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 50/101] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:39:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:57.776105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:57.938542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57bd3dd-33a6-43c4-be09-404110fbd597 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:58.017763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7fc6-849d-44ca-b337-d1a7f53be91b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-a0w49bNS_i7KOZF86DaCQ, audit_chain_id=['-a0w49bNS_i7KOZF86DaCQ']) at 0x7fe8a1581070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:58.018661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7fc6-849d-44ca-b337-d1a7f53be91b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:58.018944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7fc6-849d-44ca-b337-d1a7f53be91b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:58.019223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7fc6-849d-44ca-b337-d1a7f53be91b None admin] PATH_INFO: `/v3/users/b420717a619248efa15fb38290bed041` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:58.046938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7fc6-849d-44ca-b337-d1a7f53be91b None admin] RBAC: Authorizing `identity:get_user(user_id=b420717a619248efa15fb38290bed041)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:58.048433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7fc6-849d-44ca-b337-d1a7f53be91b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:58.050444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 52/102] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:39:57 2022] GET /identity/v3/users/b420717a619248efa15fb38290bed041 => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:58.059292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:58.266822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55c27b-676a-4129-be58-0cf136993cbd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:58.317781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-a0w49bNS_i7KOZF86DaCQ, audit_chain_id=['-a0w49bNS_i7KOZF86DaCQ']) at 0x7fe8a1515940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:58.318472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:58.318762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:58.319047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:58.330617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23896e17-6ec2-487d-a1d4-e8ead3a7e625 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:58.331313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23896e17-6ec2-487d-a1d4-e8ead3a7e625 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:58.331313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23896e17-6ec2-487d-a1d4-e8ead3a7e625 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:58.332528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 53/103] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:58.342494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:58.342760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:58.343032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:58.389006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:58.389006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:58.438402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:58.441173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:58.463425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 54/104] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:58.499328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:58.757162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae5669-8fd9-43f7-8b63-3e21f4d4f3f7 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:58.778251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 51/105] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:39:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:39:58.799554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:58.860192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IUEy-KhdTLGuR3vXX5U0kQ, audit_chain_id=['IUEy-KhdTLGuR3vXX5U0kQ']) at 0x7fe8a1561c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:58.861512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:58.861977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:58.862417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:58.865596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:58.868424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:58.872838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 55/106] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:39:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:39:58.879462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:59.108814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac5d166-8aec-47d4-b6ca-2231d32c426e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:59.135074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c40d92-fd9b-42f5-8f9d-d295a9f4e37c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:59.174818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f3d6a8-fbe1-4a01-87e2-fc38384b2492 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-a0w49bNS_i7KOZF86DaCQ, audit_chain_id=['-a0w49bNS_i7KOZF86DaCQ']) at 0x7fe8a182c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:59.175878 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IUEy-KhdTLGuR3vXX5U0kQ, audit_chain_id=['IUEy-KhdTLGuR3vXX5U0kQ']) at 0x7fe8a160ca90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:59.176567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.176919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.177290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.177587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d6a8-fbe1-4a01-87e2-fc38384b2492 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.178028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:59.178491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d6a8-fbe1-4a01-87e2-fc38384b2492 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.179201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3d6a8-fbe1-4a01-87e2-fc38384b2492 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.179536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:59.182047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d6a8-fbe1-4a01-87e2-fc38384b2492 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:59.185693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f3d6a8-fbe1-4a01-87e2-fc38384b2492 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:59.189419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 52/107] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:39:58 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:59.200182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baa451-8bcb-4ecb-b110-fc4ee54782f5 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.201097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baa451-8bcb-4ecb-b110-fc4ee54782f5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.201510 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3baa451-8bcb-4ecb-b110-fc4ee54782f5 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.204398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 53/108] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:59.206660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd49386-d10a-4cae-9e9f-57cf15f99689 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.207204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd49386-d10a-4cae-9e9f-57cf15f99689 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.207992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd49386-d10a-4cae-9e9f-57cf15f99689 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.210852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 54/109] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:59.213914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 56/110] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:39:58 2022] POST /identity/v3/projects => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:39:59.215777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:59.219718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.220323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.220862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.260710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:59.266989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:59.343216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df3dc64-9db7-4d59-a0fc-48996f0e63d5 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:59.382604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-a0w49bNS_i7KOZF86DaCQ, audit_chain_id=['-a0w49bNS_i7KOZF86DaCQ']) at 0x7fe8a15f6cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:59.383638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.384124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.384617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.385981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] RBAC: Adding query filter params (role.id=7d0ab02adc9a4f9598ba0d9ea150b834, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=b420717a619248efa15fb38290bed041) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:59.387325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:59.389070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be56904-3027-42f7-b1b8-b42687498334 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:59.399044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 57/111] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:39:59 2022] GET /identity/v3/role_assignments?user.id=b420717a619248efa15fb38290bed041&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=7d0ab02adc9a4f9598ba0d9ea150b834 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:59.400715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74844-931e-482e-9b79-a4cd6ed6934b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.401286 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74844-931e-482e-9b79-a4cd6ed6934b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.402552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f74844-931e-482e-9b79-a4cd6ed6934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.423413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-20f74844-931e-482e-9b79-a4cd6ed6934b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:59.424969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-20f74844-931e-482e-9b79-a4cd6ed6934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:59.436491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 55/112] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:59.505378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:59.507844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 58/113] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:39:59.549059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdc9bc-4440-45f6-9434-f7263fc0339a None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.549362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdc9bc-4440-45f6-9434-f7263fc0339a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.549630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afdc9bc-4440-45f6-9434-f7263fc0339a None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.551056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 59/114] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:59.559144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.559477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.559709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.593642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:39:59.593642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:39:59.696464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059be1a-4294-4009-9e76-57e0fb1d873d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:59.745264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87532e59-a6b1-4c17-8b27-0402044c8563 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qazuw1YSQv26bKtiXx11PA, audit_chain_id=['qazuw1YSQv26bKtiXx11PA']) at 0x7fe8a153bf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:59.746880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87532e59-a6b1-4c17-8b27-0402044c8563 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.747209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87532e59-a6b1-4c17-8b27-0402044c8563 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.747676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87532e59-a6b1-4c17-8b27-0402044c8563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.765096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 60/115] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:39:59.766721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:59.768191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87532e59-a6b1-4c17-8b27-0402044c8563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-87532e59-a6b1-4c17-8b27-0402044c8563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:59.776123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:59.777099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:39:59.777859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 56/116] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:39:59.781081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c91c30-5c55-4b48-bf08-3cd639e720db None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.781081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c91c30-5c55-4b48-bf08-3cd639e720db None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.781081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c91c30-5c55-4b48-bf08-3cd639e720db None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.781437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 57/117] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:39:59.786239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c91c30-5c55-4b48-bf08-3cd639e720db None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:39:59.922812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20072c-4691-4924-b751-3f8a8e68c933 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:59.925764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c91c30-5c55-4b48-bf08-3cd639e720db None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:39:59.960690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BO-EzZ22SbKcgJfOclG0Ug, audit_chain_id=['BO-EzZ22SbKcgJfOclG0Ug']) at 0x7fe8a1575a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:59.961455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.961741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.962134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.969307 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qazuw1YSQv26bKtiXx11PA, audit_chain_id=['qazuw1YSQv26bKtiXx11PA']) at 0x7fe8a14e5a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:39:59.970379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.970837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.971325 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.972261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:39:59.972772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:39:59.974718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86d6f2-de06-45dd-9402-aa6d5ef86869 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:39:59.984556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:39:59.985710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 58/118] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:39:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:39:59.987157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:39:59.987625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:39:59.988124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:39:59.996810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:39:59.997920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:39:59.998766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:00.002026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 61/119] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:39:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:00.006291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.019836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:00.021308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:00.107184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 59/120] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:00.108503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.140521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55804534-e3b0-4088-907f-52382a54da57 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.189674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wS0_Z7jzRxShVASSRd6a_Q, audit_chain_id=['wS0_Z7jzRxShVASSRd6a_Q']) at 0x7fe8a1575c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.190484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.190781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.191044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.202655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:00.210554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:00.211469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:00.212234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 62/121] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:00.212847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.221250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccafc6b-93c3-42b2-a7ee-6ff853deb77d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.257538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qazuw1YSQv26bKtiXx11PA, audit_chain_id=['qazuw1YSQv26bKtiXx11PA']) at 0x7fe8a15153d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.258519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.259013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.259477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.261962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.263798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.265846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 60/122] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.266640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.319854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b07cdf-5853-418b-a376-e3c673563a5c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.357100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BO-EzZ22SbKcgJfOclG0Ug, audit_chain_id=['BO-EzZ22SbKcgJfOclG0Ug']) at 0x7fe8a1517970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.357862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.358135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.358423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.359220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:00.359758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.361792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.372010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 63/123] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.373077 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.380995 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae021cf-c003-4308-9141-c7ebcfa26e54 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.417366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSkSTFXESBah6SYsmK2w2w, audit_chain_id=['lSkSTFXESBah6SYsmK2w2w']) at 0x7fe8a1526fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.418709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.418991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.419269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.430757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:00.439002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:00.441119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 61/124] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:00.443001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.485771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cb952-bb37-4bef-8910-63d085f4867f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.521826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wS0_Z7jzRxShVASSRd6a_Q, audit_chain_id=['wS0_Z7jzRxShVASSRd6a_Q']) at 0x7fe8a1586280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.522509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.522794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.523074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.523833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:00.524141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.525662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.535568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 64/125] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.536642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.546810 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cad27a-4f1a-4a0f-8f80-beaf8cb08d67 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.582716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qazuw1YSQv26bKtiXx11PA, audit_chain_id=['qazuw1YSQv26bKtiXx11PA']) at 0x7fe8a14daca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.583824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.584335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.584798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.586972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.588513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.590853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 62/126] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.591643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.643402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218e1597-c6d8-401f-bebe-67b3d37bfed1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.679565 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BO-EzZ22SbKcgJfOclG0Ug, audit_chain_id=['BO-EzZ22SbKcgJfOclG0Ug']) at 0x7fe8a36bbd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.680453 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.680736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.681190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.683382 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.685174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.687290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 65/127] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.688720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.718547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d7ac4-9901-4524-8bc0-741a1cc396ac None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.757172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSkSTFXESBah6SYsmK2w2w, audit_chain_id=['lSkSTFXESBah6SYsmK2w2w']) at 0x7fe8a155f1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.757782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.758069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.758352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.759107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:00.759414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.761084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.770188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 63/128] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.770874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.806450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0d50c-07a2-4715-a8f1-74e8898c6f18 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.845336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wS0_Z7jzRxShVASSRd6a_Q, audit_chain_id=['wS0_Z7jzRxShVASSRd6a_Q']) at 0x7fe8a15df2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.846268 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.846554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.846831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.848071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.849623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.851638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 66/129] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:00.852535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:00.879976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade153c-f1d2-4219-824c-360b7c2dfba2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:00.915850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qazuw1YSQv26bKtiXx11PA, audit_chain_id=['qazuw1YSQv26bKtiXx11PA']) at 0x7fe8a31910a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:00.917390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:00.918423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:00.918889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df/users/bb55de117ea24c3f87df0a228e17033a/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:00.921279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb08088328845eabe2e402d4f9491df, user_id=bb55de117ea24c3f87df0a228e17033a, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:00.922756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:00.943945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 64/130] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:00 2022] PUT /identity/v3/projects/6fb08088328845eabe2e402d4f9491df/users/bb55de117ea24c3f87df0a228e17033a/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:00.954123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:01.015156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83b29e-7641-4c9a-afbc-61cc741eb116 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.114121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ac233-04ea-412d-86dc-1cb08a698987 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.158140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BO-EzZ22SbKcgJfOclG0Ug, audit_chain_id=['BO-EzZ22SbKcgJfOclG0Ug']) at 0x7fe8a1573af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.159540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.160021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.160492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] PATH_INFO: `/v3/projects/13d71a65689441049a3427e4913aa4bd` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.166383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] RBAC: Authorizing `identity:get_project(project_id=13d71a65689441049a3427e4913aa4bd)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.169893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.174550 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 67/131] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/projects/13d71a65689441049a3427e4913aa4bd => generated 312 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:01.176723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:01.185131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSkSTFXESBah6SYsmK2w2w, audit_chain_id=['lSkSTFXESBah6SYsmK2w2w']) at 0x7fe8a1515b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.186826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.187976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.189328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.195382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.201050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.210736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 65/132] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:00 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:01.212566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:01.360374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae0c08-890f-467c-8e0c-f5f025f4b720 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.373877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389de5f-3b5f-42e7-b71c-0ec7a81adb56 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.395862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wS0_Z7jzRxShVASSRd6a_Q, audit_chain_id=['wS0_Z7jzRxShVASSRd6a_Q']) at 0x7fe8a15ffbb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.396738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.397048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.397332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.398607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.400087 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.402735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 68/133] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:01 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:01.403341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:01.421456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=BO-EzZ22SbKcgJfOclG0Ug, audit_chain_id=['BO-EzZ22SbKcgJfOclG0Ug']) at 0x7fe8a1525b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.423000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.423505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.423921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] PATH_INFO: `/v3/projects/13d71a65689441049a3427e4913aa4bd/users/bb55de117ea24c3f87df0a228e17033a/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.430593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=13d71a65689441049a3427e4913aa4bd, user_id=bb55de117ea24c3f87df0a228e17033a, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.432312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.460383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 66/134] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:01 2022] PUT /identity/v3/projects/13d71a65689441049a3427e4913aa4bd/users/bb55de117ea24c3f87df0a228e17033a/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:01.461579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:01.513257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949c64a-d810-4e9c-854d-20a56fc37683 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.556510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSkSTFXESBah6SYsmK2w2w, audit_chain_id=['lSkSTFXESBah6SYsmK2w2w']) at 0x7fe8a158d910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.557555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.557843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.558120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.559871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.561766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.563547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 69/135] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:01 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:01.572693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:01.674767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c49fa-c252-44f3-b1c3-f3f8e6f2dfd7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.715798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625af0b-3c91-48da-be25-041b0eab8b55 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wS0_Z7jzRxShVASSRd6a_Q, audit_chain_id=['wS0_Z7jzRxShVASSRd6a_Q']) at 0x7fe8a14dc790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.717106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf4899-64df-45f7-851a-a0d1d8935aee None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:01.717376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625af0b-3c91-48da-be25-041b0eab8b55 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.717870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625af0b-3c91-48da-be25-041b0eab8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.718341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625af0b-3c91-48da-be25-041b0eab8b55 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df/users/94afba6895414851b5641f8db5e9fdde/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.720766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625af0b-3c91-48da-be25-041b0eab8b55 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb08088328845eabe2e402d4f9491df, user_id=94afba6895414851b5641f8db5e9fdde, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.722524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625af0b-3c91-48da-be25-041b0eab8b55 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.742838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 67/136] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:01 2022] PUT /identity/v3/projects/6fb08088328845eabe2e402d4f9491df/users/94afba6895414851b5641f8db5e9fdde/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:01.759295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663cfe2-6b92-4953-8e00-977cb23e5fe2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lSkSTFXESBah6SYsmK2w2w, audit_chain_id=['lSkSTFXESBah6SYsmK2w2w']) at 0x7fe8a1586dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:01.760491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663cfe2-6b92-4953-8e00-977cb23e5fe2 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:01.760782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663cfe2-6b92-4953-8e00-977cb23e5fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:01.761101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663cfe2-6b92-4953-8e00-977cb23e5fe2 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df/users/bb55de117ea24c3f87df0a228e17033a/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:01.763835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663cfe2-6b92-4953-8e00-977cb23e5fe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb08088328845eabe2e402d4f9491df, user_id=bb55de117ea24c3f87df0a228e17033a, role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:01.765399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663cfe2-6b92-4953-8e00-977cb23e5fe2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:01.804998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 70/137] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:01 2022] PUT /identity/v3/projects/6fb08088328845eabe2e402d4f9491df/users/bb55de117ea24c3f87df0a228e17033a/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:02.239939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2ea3-5066-496b-9f9d-e6e8fab73ad1 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.240627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2ea3-5066-496b-9f9d-e6e8fab73ad1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.241169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db2ea3-5066-496b-9f9d-e6e8fab73ad1 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.243062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 68/138] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:02.250875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42696857-db7c-455f-982c-09940b112431 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.251479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42696857-db7c-455f-982c-09940b112431 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.251956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42696857-db7c-455f-982c-09940b112431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.272592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-42696857-db7c-455f-982c-09940b112431 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:02.274401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-42696857-db7c-455f-982c-09940b112431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:02.356791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 71/139] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:02.373445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f81c8-e30c-48dc-980f-e3b851b68cc6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.374058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f81c8-e30c-48dc-980f-e3b851b68cc6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.374556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f81c8-e30c-48dc-980f-e3b851b68cc6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.376396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 69/140] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:02.381880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.382360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.382430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.384490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f81c8-e30c-48dc-980f-e3b851b68cc6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:02.414129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:02.415349 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:02.533761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f81c8-e30c-48dc-980f-e3b851b68cc6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:02.584890 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 72/141] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:02.612404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DqqH8JNWSs6ikdW_KdAFyA, audit_chain_id=['DqqH8JNWSs6ikdW_KdAFyA']) at 0x7fe8a1512ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:02.613232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.613518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.613794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.618262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:02.619962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:02.622550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 70/142] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:02.628209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:02.670507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:02.852875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabda85-ea37-4df2-a0f0-eaed48dc7dc4 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:02.877024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85c0e3-20eb-485f-9c3e-4bf5b2d4af7d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:02.934882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54661e96-7daa-4434-8292-7a852551baba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=DqqH8JNWSs6ikdW_KdAFyA, audit_chain_id=['DqqH8JNWSs6ikdW_KdAFyA']) at 0x7fe8a15750a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:02.935576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54661e96-7daa-4434-8292-7a852551baba None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.935868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54661e96-7daa-4434-8292-7a852551baba None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.936144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54661e96-7daa-4434-8292-7a852551baba None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.936888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54661e96-7daa-4434-8292-7a852551baba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:02.938364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54661e96-7daa-4434-8292-7a852551baba None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:02.973113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uKfgfQ0WTq-D7csP5QnnUg, audit_chain_id=['uKfgfQ0WTq-D7csP5QnnUg']) at 0x7fe8a15793d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:02.973950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:02.974314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:02.974597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:02.984912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 73/143] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:02 2022] POST /identity/v3/users => generated 283 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:03.001762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:03.009653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:03.010775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:03.011567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 71/144] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:03.018633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54661e96-7daa-4434-8292-7a852551baba None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:03.175995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54661e96-7daa-4434-8292-7a852551baba None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:03.233419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uKfgfQ0WTq-D7csP5QnnUg, audit_chain_id=['uKfgfQ0WTq-D7csP5QnnUg']) at 0x7fe8a195d970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:03.234160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:03.234454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:03.234738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:03.235513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:03.235825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:03.237731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:03.256440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 74/145] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:03.263881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:03.381771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc05e8-fce4-4254-b6da-f07a8680d825 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:03.420420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uKfgfQ0WTq-D7csP5QnnUg, audit_chain_id=['uKfgfQ0WTq-D7csP5QnnUg']) at 0x7fe8a14e42b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:03.421335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:03.421623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:03.421904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] PATH_INFO: `/v3/users/b420717a619248efa15fb38290bed041` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:03.425219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] RBAC: Authorizing `identity:get_user(user_id=b420717a619248efa15fb38290bed041)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:03.427688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:03.429852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 72/146] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:03 2022] GET /identity/v3/users/b420717a619248efa15fb38290bed041 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:03.436606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:03.561774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c9911a-a842-4265-994b-b876e6059862 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:03.598437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f7bbc-2441-46c0-9669-fe46c609e8f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uKfgfQ0WTq-D7csP5QnnUg, audit_chain_id=['uKfgfQ0WTq-D7csP5QnnUg']) at 0x7fe8a1582dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:03.599365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7bbc-2441-46c0-9669-fe46c609e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:03.599697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7bbc-2441-46c0-9669-fe46c609e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:03.599980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f7bbc-2441-46c0-9669-fe46c609e8f3 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:03.601303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f7bbc-2441-46c0-9669-fe46c609e8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:03.602795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f7bbc-2441-46c0-9669-fe46c609e8f3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:03.604573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 75/147] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:03 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:03.611297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:03.724455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd45ec3-64b0-47d4-9a78-be330e69506f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:03.762897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc63cf47-fe23-4efe-86e9-d1389e80ea99 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uKfgfQ0WTq-D7csP5QnnUg, audit_chain_id=['uKfgfQ0WTq-D7csP5QnnUg']) at 0x7fe8a14da730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:03.763810 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63cf47-fe23-4efe-86e9-d1389e80ea99 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:03.764095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63cf47-fe23-4efe-86e9-d1389e80ea99 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:03.764374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc63cf47-fe23-4efe-86e9-d1389e80ea99 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df/users/b420717a619248efa15fb38290bed041/roles/7d0ab02adc9a4f9598ba0d9ea150b834` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:03.766468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63cf47-fe23-4efe-86e9-d1389e80ea99 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb08088328845eabe2e402d4f9491df, user_id=b420717a619248efa15fb38290bed041, role_id=7d0ab02adc9a4f9598ba0d9ea150b834)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:03.767935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc63cf47-fe23-4efe-86e9-d1389e80ea99 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:03.787747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 73/148] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:03 2022] PUT /identity/v3/projects/6fb08088328845eabe2e402d4f9491df/users/b420717a619248efa15fb38290bed041/roles/7d0ab02adc9a4f9598ba0d9ea150b834 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:04.704491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56250c-5e06-493f-b4f6-459641805c06 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:04.705021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56250c-5e06-493f-b4f6-459641805c06 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:04.705096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56250c-5e06-493f-b4f6-459641805c06 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:04.706822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 76/149] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:04.712588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:04.713115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:04.713316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:04.734185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:04.735413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:04.812879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 74/150] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:04.850345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e5af-a06b-40f4-bafc-d332fc19090d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:04.850642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e5af-a06b-40f4-bafc-d332fc19090d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:04.850906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086e5af-a06b-40f4-bafc-d332fc19090d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:04.852292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 77/151] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:04.854565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:04.859359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:04.859642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:04.859923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:04.886930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:04.888920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:04.985012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2294e2-6de2-4571-aa8f-e23913385a86 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.018951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 78/152] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:05.025803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z_7pC-nNRoqfgDfiy0fD-Q, audit_chain_id=['Z_7pC-nNRoqfgDfiy0fD-Q']) at 0x7fe8a14e2070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.026628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.027415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.027904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.050929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:05.057336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:05.062685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:05.063579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:05.064338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 75/153] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:05.071743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:05.194673 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399d84-9a56-46e6-be97-793229634b90 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.223832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177f612-9a7c-40a0-aefd-415056214df2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.244546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z_7pC-nNRoqfgDfiy0fD-Q, audit_chain_id=['Z_7pC-nNRoqfgDfiy0fD-Q']) at 0x7fe8a14f73a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.245259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.245541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.246342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.247108 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:05.247466 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:05.248890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:05.265073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 76/154] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:05.271186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:05.272176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ICizDiEGQlauVB6FRjY0Ag, audit_chain_id=['ICizDiEGQlauVB6FRjY0Ag']) at 0x7fe8a160c640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.273552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.274052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.274462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.299095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:05.311987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:05.314484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:05.316372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 79/155] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:05.323759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:05.485104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28ac62-3246-44e0-bdc9-3ae6bb727f52 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.538049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f9ece-34f0-42c1-8aca-4ed55d168605 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.571188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe11360-3cfc-46cb-83d7-a911276ff8a7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z_7pC-nNRoqfgDfiy0fD-Q, audit_chain_id=['Z_7pC-nNRoqfgDfiy0fD-Q']) at 0x7fe8a14eedf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.572449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11360-3cfc-46cb-83d7-a911276ff8a7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.572727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11360-3cfc-46cb-83d7-a911276ff8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.573011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe11360-3cfc-46cb-83d7-a911276ff8a7 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.574979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe11360-3cfc-46cb-83d7-a911276ff8a7 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:05.576944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe11360-3cfc-46cb-83d7-a911276ff8a7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:05.579119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 77/156] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:05 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:05.580361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016687c-50a1-401a-b862-e6a4758a59f3 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.580919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016687c-50a1-401a-b862-e6a4758a59f3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.581229 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a016687c-50a1-401a-b862-e6a4758a59f3 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.590872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 78/157] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:05.591915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016687c-50a1-401a-b862-e6a4758a59f3 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:05.626949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ICizDiEGQlauVB6FRjY0Ag, audit_chain_id=['ICizDiEGQlauVB6FRjY0Ag']) at 0x7fe8a154c760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.627647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.627936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.628217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.629012 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:05.629332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:05.630758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26c729-9198-49a5-b717-1ae306adcc93 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:05.653447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 80/158] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:05.658181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.658500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.658783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.698089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:05.699575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:05.811688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 81/159] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:05.812400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:05.818703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a016687c-50a1-401a-b862-e6a4758a59f3 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.903314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z_7pC-nNRoqfgDfiy0fD-Q, audit_chain_id=['Z_7pC-nNRoqfgDfiy0fD-Q']) at 0x7fe8a1515940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.903998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.904278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.904552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.940635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ddf7c1-94f7-40a7-a980-83ff7979b1d9 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:05.986831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ICizDiEGQlauVB6FRjY0Ag, audit_chain_id=['ICizDiEGQlauVB6FRjY0Ag']) at 0x7fe8a151cd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:05.988184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:05.991305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:05.991791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:05.994312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:06.005430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:06.007510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 82/160] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:05 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:06.008533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:06.051406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:06.053195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:06.151497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95465-1423-4155-96b0-2a422c448723 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:06.190250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 79/161] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:06.191418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:06.193487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z44Gl7TVRpyfWuSeb_Soxg, audit_chain_id=['Z44Gl7TVRpyfWuSeb_Soxg']) at 0x7fe8a15248e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:06.194313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:06.194595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:06.194869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:06.221777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:06.238034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:06.238980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:06.240019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 83/162] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:06.240673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:06.304340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f354f-317d-4179-90a6-5dea9e744ae2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:06.347774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a76904-808c-43dd-8985-dc6b34c57508 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ICizDiEGQlauVB6FRjY0Ag, audit_chain_id=['ICizDiEGQlauVB6FRjY0Ag']) at 0x7fe8a14e13a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:06.349122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76904-808c-43dd-8985-dc6b34c57508 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:06.349613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76904-808c-43dd-8985-dc6b34c57508 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:06.350139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a76904-808c-43dd-8985-dc6b34c57508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:06.482000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76904-808c-43dd-8985-dc6b34c57508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:06.483415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a76904-808c-43dd-8985-dc6b34c57508 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:06.484907 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2272ddb-42d4-45ca-a60e-5135cffa0de2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:06.573917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z_7pC-nNRoqfgDfiy0fD-Q, audit_chain_id=['Z_7pC-nNRoqfgDfiy0fD-Q']) at 0x7fe8a1531c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:06.575535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:06.575663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:06.575948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:06.577439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:06.578920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:06.581025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 84/163] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:06 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:06.581824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:06.702240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450eda56-570d-4536-b232-174ec4dfa4cb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:06.732771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 80/164] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:06.734086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5f221-50c3-499e-8740-7338105cd0e7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:06.734377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5f221-50c3-499e-8740-7338105cd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:06.734654 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5f221-50c3-499e-8740-7338105cd0e7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:06.735973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 81/165] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:06.742072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5f221-50c3-499e-8740-7338105cd0e7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:06.754753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z44Gl7TVRpyfWuSeb_Soxg, audit_chain_id=['Z44Gl7TVRpyfWuSeb_Soxg']) at 0x7fe8a1528c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:06.755446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:06.755730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:06.756005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:06.756771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:06.757103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:06.758501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:06.778129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 85/166] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:06.778731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:06.978158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906f3fa-81df-4f0b-a6eb-4dee20a7b8bc None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:07.034780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5f221-50c3-499e-8740-7338105cd0e7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:07.054780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc317c-9c2c-49d0-9fd7-91ae73246686 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ICizDiEGQlauVB6FRjY0Ag, audit_chain_id=['ICizDiEGQlauVB6FRjY0Ag']) at 0x7fe8a1586280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:07.056531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc317c-9c2c-49d0-9fd7-91ae73246686 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.057331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc317c-9c2c-49d0-9fd7-91ae73246686 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.057830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc317c-9c2c-49d0-9fd7-91ae73246686 None admin] PATH_INFO: `/v3/projects/13d71a65689441049a3427e4913aa4bd` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.060008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc317c-9c2c-49d0-9fd7-91ae73246686 None admin] RBAC: Authorizing `identity:get_project(project_id=13d71a65689441049a3427e4913aa4bd)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:07.061724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc317c-9c2c-49d0-9fd7-91ae73246686 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:07.064236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 86/167] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:06 2022] GET /identity/v3/projects/13d71a65689441049a3427e4913aa4bd => generated 312 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:07.065734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.066250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.066751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.102150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:07.103963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:07.126483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z_7pC-nNRoqfgDfiy0fD-Q, audit_chain_id=['Z_7pC-nNRoqfgDfiy0fD-Q']) at 0x7fe8a14ff970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:07.127477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.127931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.128348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.129375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=bb55de117ea24c3f87df0a228e17033a) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:07.129833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:07.131447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:07.147298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 82/168] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:06 2022] GET /identity/v3/role_assignments?user.id=bb55de117ea24c3f87df0a228e17033a&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 608 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:07.148387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:07.263705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 87/169] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:07.264001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:07.322754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15909e21-f7e2-4226-a221-aa19425895cf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:07.407860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z44Gl7TVRpyfWuSeb_Soxg, audit_chain_id=['Z44Gl7TVRpyfWuSeb_Soxg']) at 0x7fe8a1512b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:07.410305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.410739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.411877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] PATH_INFO: `/v3/users/bb55de117ea24c3f87df0a228e17033a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.413973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] RBAC: Authorizing `identity:get_user(user_id=bb55de117ea24c3f87df0a228e17033a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:07.415778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:07.420376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 83/170] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:07 2022] GET /identity/v3/users/bb55de117ea24c3f87df0a228e17033a => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:07.422313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:07.528921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b609a3f-fac6-45fa-8d48-eb5bb145f5d8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:07.614851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ICizDiEGQlauVB6FRjY0Ag, audit_chain_id=['ICizDiEGQlauVB6FRjY0Ag']) at 0x7fe8a151c070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:07.615495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.615826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.616107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.616601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1339cee-3c5f-4643-afc5-39e7e459cf6b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:07.616950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=13d71a65689441049a3427e4913aa4bd, user.id=bb55de117ea24c3f87df0a228e17033a) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:07.617283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:07.618738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:07.630217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 88/171] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:07 2022] GET /identity/v3/role_assignments?user.id=bb55de117ea24c3f87df0a228e17033a&scope.project.id=13d71a65689441049a3427e4913aa4bd&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:07.631176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:07.673627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9f9a1-6749-4487-aa14-a128ce242541 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QdL6-Zd3RgGmK-vYPNZZDg, audit_chain_id=['QdL6-Zd3RgGmK-vYPNZZDg']) at 0x7fe8a1549eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:07.674625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f9a1-6749-4487-aa14-a128ce242541 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.674917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f9a1-6749-4487-aa14-a128ce242541 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.675193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f9a1-6749-4487-aa14-a128ce242541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.691308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9f9a1-6749-4487-aa14-a128ce242541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-27c9f9a1-6749-4487-aa14-a128ce242541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:07.699987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:07.701659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:07.703362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:07.706910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 84/172] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:07.713027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602406-69ba-4718-b576-d6baa99c7411 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.713027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602406-69ba-4718-b576-d6baa99c7411 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.713027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d602406-69ba-4718-b576-d6baa99c7411 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.713027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 85/173] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:07.716107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.716338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.716634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.750211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:07.750211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:07.845576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d2b28f-4f00-4429-aac3-cb94b4e1c3b9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:07.867872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 86/174] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:07.868498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:07.898828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z44Gl7TVRpyfWuSeb_Soxg, audit_chain_id=['Z44Gl7TVRpyfWuSeb_Soxg']) at 0x7fe8a16045e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:07.899508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:07.899792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:07.900064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:07.994648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62d050c-347d-40c9-8367-a5b7344ce3e2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.003116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.004615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.046866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QdL6-Zd3RgGmK-vYPNZZDg, audit_chain_id=['QdL6-Zd3RgGmK-vYPNZZDg']) at 0x7fe8a14ff790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.047547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.047817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.048091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.048854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:08.049182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.050600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.068205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 87/175] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:08.069120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.134328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 89/176] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:08.135292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.200687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9237e6-a0ac-48d8-965f-f13e721d6df5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.237311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e8303-41c6-4e30-a676-49e6cbd8bacb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=37C4h5wzQsOckG57bNGw3A, audit_chain_id=['37C4h5wzQsOckG57bNGw3A']) at 0x7fe8a14e2a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.238378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8303-41c6-4e30-a676-49e6cbd8bacb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.238803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8303-41c6-4e30-a676-49e6cbd8bacb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.239250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e8303-41c6-4e30-a676-49e6cbd8bacb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.251875 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e8303-41c6-4e30-a676-49e6cbd8bacb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:08.255507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0387a33-1cee-40ac-a58b-58860928b33d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-f81e8303-41c6-4e30-a676-49e6cbd8bacb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:08.259777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:08.260931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:08.261969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:08.264264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 88/177] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:08.265820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca8e5-ec90-4690-a027-fc45fae46e5c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.266323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca8e5-ec90-4690-a027-fc45fae46e5c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.266791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cca8e5-ec90-4690-a027-fc45fae46e5c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.268324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 89/178] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:08.269280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca8e5-ec90-4690-a027-fc45fae46e5c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.301875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QdL6-Zd3RgGmK-vYPNZZDg, audit_chain_id=['QdL6-Zd3RgGmK-vYPNZZDg']) at 0x7fe8a15f6790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.302811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.303139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.303417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] PATH_INFO: `/v3/users/94afba6895414851b5641f8db5e9fdde` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.304700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] RBAC: Authorizing `identity:get_user(user_id=94afba6895414851b5641f8db5e9fdde)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.306271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.308093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 90/179] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/users/94afba6895414851b5641f8db5e9fdde => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:08.309519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.382026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cca8e5-ec90-4690-a027-fc45fae46e5c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.419415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be71e94-edf4-4c0c-ae85-1b5831decac8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z44Gl7TVRpyfWuSeb_Soxg, audit_chain_id=['Z44Gl7TVRpyfWuSeb_Soxg']) at 0x7fe8a14fad60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.419808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f0496-fcca-474b-825f-3c00c4ba1e1d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.420760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be71e94-edf4-4c0c-ae85-1b5831decac8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.421285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be71e94-edf4-4c0c-ae85-1b5831decac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.421754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be71e94-edf4-4c0c-ae85-1b5831decac8 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.423202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be71e94-edf4-4c0c-ae85-1b5831decac8 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.424862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be71e94-edf4-4c0c-ae85-1b5831decac8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.426834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 90/180] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:08.428272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.428762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.429289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.447215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:08.448785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:08.460525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=37C4h5wzQsOckG57bNGw3A, audit_chain_id=['37C4h5wzQsOckG57bNGw3A']) at 0x7fe8a1586fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.461250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.461769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.462243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.463183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:08.463670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.466098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.475879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 91/181] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:08.477218 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.535880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 91/182] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:08.537019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.622764 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae1a0ec-5c46-4f41-912c-a46a455240e6 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.666439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64f130-68ab-435e-9d65-14b5ad91ed04 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.675446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QdL6-Zd3RgGmK-vYPNZZDg, audit_chain_id=['QdL6-Zd3RgGmK-vYPNZZDg']) at 0x7fe8a1581520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.676403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.676883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.677374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.704478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Z44Gl7TVRpyfWuSeb_Soxg, audit_chain_id=['Z44Gl7TVRpyfWuSeb_Soxg']) at 0x7fe8a14d3460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.705303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.705652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.705995 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.706914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] RBAC: Adding query filter params (role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=bb55de117ea24c3f87df0a228e17033a) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:08.707299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.708959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.715888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 92/183] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/role_assignments?user.id=bb55de117ea24c3f87df0a228e17033a&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:08.717280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.763795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.765678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.834629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec933c51-5219-49fd-a914-6638e013f32a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:08.876615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d9e1b9-2318-429f-8906-8ef822170c98 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=37C4h5wzQsOckG57bNGw3A, audit_chain_id=['37C4h5wzQsOckG57bNGw3A']) at 0x7fe8a14e20d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:08.878415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9e1b9-2318-429f-8906-8ef822170c98 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.879028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9e1b9-2318-429f-8906-8ef822170c98 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.879608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d9e1b9-2318-429f-8906-8ef822170c98 None admin] PATH_INFO: `/v3/users/065aa58cea354e5e8cf86187dbad2732` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.893353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 92/184] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:08.894696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:08.904253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9e1b9-2318-429f-8906-8ef822170c98 None admin] RBAC: Authorizing `identity:get_user(user_id=065aa58cea354e5e8cf86187dbad2732)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:08.906177 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d9e1b9-2318-429f-8906-8ef822170c98 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:08.907969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 93/185] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/users/065aa58cea354e5e8cf86187dbad2732 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:08.913213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d684-3394-4dd3-b054-a34e70477909 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:08.913213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d684-3394-4dd3-b054-a34e70477909 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:08.913213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5d684-3394-4dd3-b054-a34e70477909 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:08.913213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 94/186] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:08.913213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5d684-3394-4dd3-b054-a34e70477909 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.035612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9443a61-d1ca-4c61-adc5-478c288fef8c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.038907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5d684-3394-4dd3-b054-a34e70477909 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.071914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4ed00-e8fd-415a-8f6d-2813ffa5ca62 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iQO9b7e6Sz-tfjiP5PSbbQ, audit_chain_id=['iQO9b7e6Sz-tfjiP5PSbbQ']) at 0x7fe8a151c5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.072715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ed00-e8fd-415a-8f6d-2813ffa5ca62 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.073011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ed00-e8fd-415a-8f6d-2813ffa5ca62 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.073294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4ed00-e8fd-415a-8f6d-2813ffa5ca62 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.076411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QdL6-Zd3RgGmK-vYPNZZDg, audit_chain_id=['QdL6-Zd3RgGmK-vYPNZZDg']) at 0x7fe8a14faa30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.077596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.077955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.078367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.079682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.081294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.083222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 95/187] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:09.083885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.085979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4ed00-e8fd-415a-8f6d-2813ffa5ca62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-fdc4ed00-e8fd-415a-8f6d-2813ffa5ca62 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:09.094258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:09.095214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 93/188] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:09.097650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5082ed-e77e-4880-82b1-1f53a3800051 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.098353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5082ed-e77e-4880-82b1-1f53a3800051 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.098353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5082ed-e77e-4880-82b1-1f53a3800051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.117210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-2b5082ed-e77e-4880-82b1-1f53a3800051 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:09.118424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2b5082ed-e77e-4880-82b1-1f53a3800051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:09.187645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af98d25-b4be-485f-9d74-189c62758d30 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.189645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 94/189] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:09.190989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171c54-b393-4f3d-84a8-d34371baf42c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.191274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171c54-b393-4f3d-84a8-d34371baf42c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.191544 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a171c54-b393-4f3d-84a8-d34371baf42c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.193082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 95/190] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:09.193554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171c54-b393-4f3d-84a8-d34371baf42c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.234017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0869b1-3176-4f62-ba9b-a650f1a41be0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=37C4h5wzQsOckG57bNGw3A, audit_chain_id=['37C4h5wzQsOckG57bNGw3A']) at 0x7fe8a14ff250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.234612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0869b1-3176-4f62-ba9b-a650f1a41be0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.234970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0869b1-3176-4f62-ba9b-a650f1a41be0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.235172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0869b1-3176-4f62-ba9b-a650f1a41be0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.301741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a171c54-b393-4f3d-84a8-d34371baf42c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.302945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0869b1-3176-4f62-ba9b-a650f1a41be0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.304426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0869b1-3176-4f62-ba9b-a650f1a41be0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.337004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QdL6-Zd3RgGmK-vYPNZZDg, audit_chain_id=['QdL6-Zd3RgGmK-vYPNZZDg']) at 0x7fe8a14dd220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.337684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.337963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.338233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.339074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=94afba6895414851b5641f8db5e9fdde) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:09.340257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.341759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.347931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 96/191] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/role_assignments?user.id=94afba6895414851b5641f8db5e9fdde&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:09.348753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.421460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 96/192] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:09.423499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873164da-a5da-4661-b719-2de087e79cac None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.423789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873164da-a5da-4661-b719-2de087e79cac None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.424063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873164da-a5da-4661-b719-2de087e79cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.443818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-873164da-a5da-4661-b719-2de087e79cac None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:09.445422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-873164da-a5da-4661-b719-2de087e79cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:09.492038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca5694-c4b5-49ea-9770-b13e46e34ecf None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.530957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iQO9b7e6Sz-tfjiP5PSbbQ, audit_chain_id=['iQO9b7e6Sz-tfjiP5PSbbQ']) at 0x7fe8a15f6b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.531643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.531928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.532206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.532968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:09.533324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.534735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.537137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 97/193] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:09.538239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873164da-a5da-4661-b719-2de087e79cac None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.554552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 97/194] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:09.555831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.658292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873164da-a5da-4661-b719-2de087e79cac None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.675247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f04b7-8365-4b46-8e86-9fc521248e58 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.691837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cd1PVuqbScK065jPppmY7w, audit_chain_id=['cd1PVuqbScK065jPppmY7w']) at 0x7fe8a1563490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.692638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.692915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.693291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.694491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.695949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.697619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 98/195] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:09.698377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.710835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=37C4h5wzQsOckG57bNGw3A, audit_chain_id=['37C4h5wzQsOckG57bNGw3A']) at 0x7fe8a1537520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.711694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.711967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.712234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.713457 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.715148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.721677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 98/196] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:09.721677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.803084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed59d8-f68b-4581-a2a2-a072f045447c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.822979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee0b661-81b5-442f-85e8-ed093ec90dd2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.840326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iQO9b7e6Sz-tfjiP5PSbbQ, audit_chain_id=['iQO9b7e6Sz-tfjiP5PSbbQ']) at 0x7fe8a158f220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.841246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.841528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.841804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] PATH_INFO: `/v3/users/b420717a619248efa15fb38290bed041` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.843086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] RBAC: Authorizing `identity:get_user(user_id=b420717a619248efa15fb38290bed041)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.844532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:09.850921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 99/197] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/users/b420717a619248efa15fb38290bed041 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:09.850921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.859275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjEJC3YzQD-hJoGBdGEEAA, audit_chain_id=['QjEJC3YzQD-hJoGBdGEEAA']) at 0x7fe8a154c340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.860093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.860370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.860640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.871477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:09.879269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:09.880204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:09.881005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 99/198] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:09.881704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:09.955867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886de3a2-7b52-481a-92e3-111ca5d65709 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.987295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e4800-ca6d-48ca-93c7-57e554457fec None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:09.989648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cd1PVuqbScK065jPppmY7w, audit_chain_id=['cd1PVuqbScK065jPppmY7w']) at 0x7fe8a14e2fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:09.990325 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:09.990605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:09.990880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:09.991598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:09.993091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.029019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 100/199] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:09 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:10.029019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.029448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=37C4h5wzQsOckG57bNGw3A, audit_chain_id=['37C4h5wzQsOckG57bNGw3A']) at 0x7fe8a14e3f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.029448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.029448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.029448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.029970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=065aa58cea354e5e8cf86187dbad2732) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:10.029970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.029970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.041018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 100/200] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:09 2022] GET /identity/v3/role_assignments?user.id=065aa58cea354e5e8cf86187dbad2732&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:10.041018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.160833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616b4757-1bf4-458b-b625-66ab94ca9a96 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:10.184308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c80dd5-56c5-407a-97d5-767cd9b98efb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:10.203914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjEJC3YzQD-hJoGBdGEEAA, audit_chain_id=['QjEJC3YzQD-hJoGBdGEEAA']) at 0x7fe8a14ee7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.204785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.205109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.205381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.206592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:10.206896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.208333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.223399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 101/201] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:10.227331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iQO9b7e6Sz-tfjiP5PSbbQ, audit_chain_id=['iQO9b7e6Sz-tfjiP5PSbbQ']) at 0x7fe8a14dca90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.228085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.228358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.228628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.231015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.326707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.328225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.390971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da55c1e-18a9-4bc9-b822-8e44dd816b1c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:10.449488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjEJC3YzQD-hJoGBdGEEAA, audit_chain_id=['QjEJC3YzQD-hJoGBdGEEAA']) at 0x7fe8a1537520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.449488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.449488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.449488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] PATH_INFO: `/v3/users/065aa58cea354e5e8cf86187dbad2732` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.451123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] RBAC: Authorizing `identity:get_user(user_id=065aa58cea354e5e8cf86187dbad2732)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.452588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.454357 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 102/202] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/users/065aa58cea354e5e8cf86187dbad2732 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:10.460093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.482594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 101/203] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:10.488910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.584693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498e7d5-39ea-4f14-a907-d086b83964ce None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:10.622523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b57daa3-685c-4fa9-962d-7f9a7a17cf92 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:10.625837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjEJC3YzQD-hJoGBdGEEAA, audit_chain_id=['QjEJC3YzQD-hJoGBdGEEAA']) at 0x7fe8a15317c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.626706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.627131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.627544 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.659217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iQO9b7e6Sz-tfjiP5PSbbQ, audit_chain_id=['iQO9b7e6Sz-tfjiP5PSbbQ']) at 0x7fe8a158f490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.660088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.660365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.660657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.663066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.664671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.666480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 102/204] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:10.672741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.723837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.725572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.779478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8b416-268c-4173-a59d-be4dcc0943f2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:10.815939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iQO9b7e6Sz-tfjiP5PSbbQ, audit_chain_id=['iQO9b7e6Sz-tfjiP5PSbbQ']) at 0x7fe8a158f1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:10.816710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:10.816877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:10.817347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:10.818032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] RBAC: Adding query filter params (role.id=7d0ab02adc9a4f9598ba0d9ea150b834, scope.project.id=6fb08088328845eabe2e402d4f9491df, user.id=b420717a619248efa15fb38290bed041) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:10.818341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:10.819820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:10.826835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 103/205] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/role_assignments?user.id=b420717a619248efa15fb38290bed041&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=7d0ab02adc9a4f9598ba0d9ea150b834 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:10.834996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 103/206] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 12:40:10.843670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:10.984405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c482316-1d4b-4ff9-87ce-11d3f3c8972f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:11.023390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f085f4-e893-4043-a16a-2d8709c0ed2a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjEJC3YzQD-hJoGBdGEEAA, audit_chain_id=['QjEJC3YzQD-hJoGBdGEEAA']) at 0x7fe8a14dc460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:11.024269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f085f4-e893-4043-a16a-2d8709c0ed2a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:11.024545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f085f4-e893-4043-a16a-2d8709c0ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:11.026118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f085f4-e893-4043-a16a-2d8709c0ed2a None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:11.028068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f085f4-e893-4043-a16a-2d8709c0ed2a None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:11.029561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f085f4-e893-4043-a16a-2d8709c0ed2a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:11.031610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 104/207] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:10 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:11.037581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:11.174398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e78e73-6da2-4c71-a31c-69248d6e57d6 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:11.224055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QjEJC3YzQD-hJoGBdGEEAA, audit_chain_id=['QjEJC3YzQD-hJoGBdGEEAA']) at 0x7fe8a16045e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:11.224726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:11.225029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:11.225308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:11.226150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] RBAC: Adding query filter params (role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=065aa58cea354e5e8cf86187dbad2732) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:11.226460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:11.227923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6bb08-4d8a-4103-81a9-eb7f26049389 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:11.237817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 104/208] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:11 2022] GET /identity/v3/role_assignments?user.id=065aa58cea354e5e8cf86187dbad2732&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:12.583670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050cf5b-c02a-41d4-86f1-331770ff1408 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:12.584185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050cf5b-c02a-41d4-86f1-331770ff1408 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:12.584259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050cf5b-c02a-41d4-86f1-331770ff1408 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:12.585733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 105/209] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:12.591941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa08a-b5a1-4a18-96cc-1e592351545e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:12.592828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa08a-b5a1-4a18-96cc-1e592351545e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:12.593346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fa08a-b5a1-4a18-96cc-1e592351545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:12.611056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-a46fa08a-b5a1-4a18-96cc-1e592351545e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:12.612568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a46fa08a-b5a1-4a18-96cc-1e592351545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:12.693089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 105/210] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:12.713122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050cf5b-c02a-41d4-86f1-331770ff1408 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:12.724750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8916-fe34-4f84-a427-f639112594ba None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:12.725386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8916-fe34-4f84-a427-f639112594ba None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:12.725863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb8916-fe34-4f84-a427-f639112594ba None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:12.727470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 106/211] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:12.733982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:12.734263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:12.734545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:12.752665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:12.754003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:12.825355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050cf5b-c02a-41d4-86f1-331770ff1408 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:12.829010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 107/212] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:12.866015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aQ1nRdVQRU68ZYNHw5n3Sw, audit_chain_id=['aQ1nRdVQRU68ZYNHw5n3Sw']) at 0x7fe8a14d3940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:12.866749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:12.867030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:12.867303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:12.869656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:12.879807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:12.888406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:12.889397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:12.895013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 106/213] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:12.897541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.002372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960c8db-62ac-43e8-9934-6d23a5be238d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.029039 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eba910f-9701-4811-8e2a-7cc14e68d5de None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.043381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W6g41anMTueWafKkHro0zw, audit_chain_id=['W6g41anMTueWafKkHro0zw']) at 0x7fe8a158d670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.044609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.045127 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.045600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.057486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:13.066442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aQ1nRdVQRU68ZYNHw5n3Sw, audit_chain_id=['aQ1nRdVQRU68ZYNHw5n3Sw']) at 0x7fe8a150af70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.067114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.067399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.067673 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:13.068303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:13.069408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:13.070212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:13.070806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:13.070806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.070806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.077110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 108/214] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:13.080113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.080525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 107/215] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:13.086261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.203683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0599dfd7-b81e-4e2b-9123-baa6dc4aaf0c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.205369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26fa426-94e3-435f-bb5d-0e5b9cecbd0a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.250414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W6g41anMTueWafKkHro0zw, audit_chain_id=['W6g41anMTueWafKkHro0zw']) at 0x7fe8a14ea760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.251094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.251374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.251659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.252413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:13.252728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.254085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf84b0b-be9e-4cd2-86bc-9385c7986480 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aQ1nRdVQRU68ZYNHw5n3Sw, audit_chain_id=['aQ1nRdVQRU68ZYNHw5n3Sw']) at 0x7fe8a1509c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.254265 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.255202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf84b0b-be9e-4cd2-86bc-9385c7986480 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.255719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf84b0b-be9e-4cd2-86bc-9385c7986480 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.256162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf84b0b-be9e-4cd2-86bc-9385c7986480 None admin] PATH_INFO: `/v3/users/065aa58cea354e5e8cf86187dbad2732` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.257872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf84b0b-be9e-4cd2-86bc-9385c7986480 None admin] RBAC: Authorizing `identity:get_user(user_id=065aa58cea354e5e8cf86187dbad2732)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.259539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf84b0b-be9e-4cd2-86bc-9385c7986480 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.262120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 108/216] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/users/065aa58cea354e5e8cf86187dbad2732 => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:13.269530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095c21f-1d1f-4d95-8997-386b5eb988a2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.269530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095c21f-1d1f-4d95-8997-386b5eb988a2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.269530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095c21f-1d1f-4d95-8997-386b5eb988a2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.271767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 109/217] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:13.272595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 109/218] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:13.276666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.277696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.278044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.278387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.295182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:13.296499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:13.368771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 110/219] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:13.369572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.393771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bac50d-9b0e-40f6-9c6a-ba4602a837fc None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.434229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aQ1nRdVQRU68ZYNHw5n3Sw, audit_chain_id=['aQ1nRdVQRU68ZYNHw5n3Sw']) at 0x7fe8a14e30d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.435114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.435393 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.435663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.437021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.438539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.440725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 110/220] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:13.446511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.478612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8e98a-0b47-44dc-ba48-a8e5353fa30d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.514041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W6g41anMTueWafKkHro0zw, audit_chain_id=['W6g41anMTueWafKkHro0zw']) at 0x7fe8a14d3340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.514918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.515197 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.515470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] PATH_INFO: `/v3/users/df515bdbf1f940ca8a2f281491c82e9a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.532098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=df515bdbf1f940ca8a2f281491c82e9a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.533659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.539644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 111/221] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/users/df515bdbf1f940ca8a2f281491c82e9a => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:13.539644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.559592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b0f43-2f6c-4a77-994b-da1a526256bf None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.594487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b9bmSKO0QxKnWzlqDh-aPw, audit_chain_id=['b9bmSKO0QxKnWzlqDh-aPw']) at 0x7fe8a1571ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.595288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.595562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.595835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.597050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.598521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.604678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 111/222] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:13.604678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.643064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516b9dc-1f2a-4038-a9f5-683cb224a7a5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.676390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=aQ1nRdVQRU68ZYNHw5n3Sw, audit_chain_id=['aQ1nRdVQRU68ZYNHw5n3Sw']) at 0x7fe8a1838b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.677306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.677582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.677847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/065aa58cea354e5e8cf86187dbad2732/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.679850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user_id=065aa58cea354e5e8cf86187dbad2732, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.681322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.694587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 112/223] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:13 2022] PUT /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/065aa58cea354e5e8cf86187dbad2732/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:13.696024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.705938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d0b18d-55f1-4dba-897b-ad8a260bf224 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.745144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W6g41anMTueWafKkHro0zw, audit_chain_id=['W6g41anMTueWafKkHro0zw']) at 0x7fe8a15311f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.746414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.746697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.746965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.809005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e15dc-5c7b-4c65-82f9-ccc12b722f3d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:13.826176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.827700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.850246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d7f80-f9de-4c99-925e-457dc08ac8e2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b9bmSKO0QxKnWzlqDh-aPw, audit_chain_id=['b9bmSKO0QxKnWzlqDh-aPw']) at 0x7fe8a1515be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:13.850939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7f80-f9de-4c99-925e-457dc08ac8e2 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.851215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7f80-f9de-4c99-925e-457dc08ac8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.851484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d7f80-f9de-4c99-925e-457dc08ac8e2 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.852215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d7f80-f9de-4c99-925e-457dc08ac8e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:13.853752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d7f80-f9de-4c99-925e-457dc08ac8e2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:13.878052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 113/224] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:13 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:13.879419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c209571-3b0b-4e69-8241-e7d8b441cbf5 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.879973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c209571-3b0b-4e69-8241-e7d8b441cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.880255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c209571-3b0b-4e69-8241-e7d8b441cbf5 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.881712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 114/225] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:13.890408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:13.891018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:13.891297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:13.911275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:13.912526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:13.959138 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 112/226] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:13.964930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:13.994782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 115/227] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:14.018040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:14.082375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084068f-eeb7-4247-b3c9-95efba91405e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:14.133856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W6g41anMTueWafKkHro0zw, audit_chain_id=['W6g41anMTueWafKkHro0zw']) at 0x7fe8a1575250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:14.134054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:14.134317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:14.134475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:14.136728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:14.137620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:14.139951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 113/228] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:13 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:14.142517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51074e5c-463e-47a3-aeda-98c2b99f9ed2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:14.145782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:14.182022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u8rKIXOgRl2QYrOmCtQVjg, audit_chain_id=['u8rKIXOgRl2QYrOmCtQVjg']) at 0x7fe8a158f220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:14.183331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:14.183878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:14.184354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:14.196627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:14.205360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:14.206257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:14.207034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:14.210710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 116/229] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:14.217090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:14.256593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad97f3d-9f65-47df-9856-c6f64abc3c25 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:14.302198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W6g41anMTueWafKkHro0zw, audit_chain_id=['W6g41anMTueWafKkHro0zw']) at 0x7fe8a1529e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:14.303695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:14.304171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:14.304604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:14.306088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=df515bdbf1f940ca8a2f281491c82e9a) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:14.306634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:14.309430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:14.315276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 114/230] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:14 2022] GET /identity/v3/role_assignments?user.id=df515bdbf1f940ca8a2f281491c82e9a&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:14.345030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1efa5-0cdb-4536-9d7a-1e7f5a9d921d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:14.382816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u8rKIXOgRl2QYrOmCtQVjg, audit_chain_id=['u8rKIXOgRl2QYrOmCtQVjg']) at 0x7fe8a14ff2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:14.383859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:14.384333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:14.384819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:14.386065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:14.386679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:14.388629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:14.399327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 117/231] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:14.404649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:14.537462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89caf4e-a010-44eb-b637-d3092db4fe9c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:14.581904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u8rKIXOgRl2QYrOmCtQVjg, audit_chain_id=['u8rKIXOgRl2QYrOmCtQVjg']) at 0x7fe8a15244f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:14.582988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:14.583280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:14.583556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] PATH_INFO: `/v3/users/065aa58cea354e5e8cf86187dbad2732` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:14.584832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] RBAC: Authorizing `identity:get_user(user_id=065aa58cea354e5e8cf86187dbad2732)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:14.586340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:14.589055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 115/232] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:14 2022] GET /identity/v3/users/065aa58cea354e5e8cf86187dbad2732 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:14.594028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:14.788208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afeffc1-a285-40ee-8b82-29fcd38ab2b8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:14.826325 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49571cce-bbb3-430b-9c16-badaa5cf54f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u8rKIXOgRl2QYrOmCtQVjg, audit_chain_id=['u8rKIXOgRl2QYrOmCtQVjg']) at 0x7fe8a14ff370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:14.827191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571cce-bbb3-430b-9c16-badaa5cf54f9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:14.827467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571cce-bbb3-430b-9c16-badaa5cf54f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:14.827739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49571cce-bbb3-430b-9c16-badaa5cf54f9 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:14.828976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571cce-bbb3-430b-9c16-badaa5cf54f9 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:14.830529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49571cce-bbb3-430b-9c16-badaa5cf54f9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:14.832726 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 118/233] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:14 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:14.838032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:15.027785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f16df0-2808-41b6-89cb-12ef0c427d28 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:15.075951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d2879-33ab-44ea-ac9b-035086c1813b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u8rKIXOgRl2QYrOmCtQVjg, audit_chain_id=['u8rKIXOgRl2QYrOmCtQVjg']) at 0x7fe8a1517b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:15.076852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2879-33ab-44ea-ac9b-035086c1813b None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:15.077161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2879-33ab-44ea-ac9b-035086c1813b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:15.077437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d2879-33ab-44ea-ac9b-035086c1813b None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/065aa58cea354e5e8cf86187dbad2732/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:15.083005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2879-33ab-44ea-ac9b-035086c1813b None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user_id=065aa58cea354e5e8cf86187dbad2732, role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:15.084448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d2879-33ab-44ea-ac9b-035086c1813b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:15.104664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 116/234] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:14 2022] PUT /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/065aa58cea354e5e8cf86187dbad2732/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:40:16.624384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69966fd-18a2-4be8-b3a4-1844e67a82cd None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:16.625208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69966fd-18a2-4be8-b3a4-1844e67a82cd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:16.625208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69966fd-18a2-4be8-b3a4-1844e67a82cd None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:16.626820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 119/235] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:16.633787 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ae136-4490-41d4-8514-d3f3958e9122 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:16.634428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ae136-4490-41d4-8514-d3f3958e9122 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:16.634428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ae136-4490-41d4-8514-d3f3958e9122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:16.658987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-128ae136-4490-41d4-8514-d3f3958e9122 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:16.660271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-128ae136-4490-41d4-8514-d3f3958e9122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:16.759103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 117/236] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:16.806624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69966fd-18a2-4be8-b3a4-1844e67a82cd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:16.859809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01eff-58ab-4e23-a705-b311138328c0 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:16.860303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01eff-58ab-4e23-a705-b311138328c0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:16.860807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f01eff-58ab-4e23-a705-b311138328c0 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:16.863939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 118/237] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:16.870431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f63a-e85a-4ea8-9259-a468d17c9237 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:16.870963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f63a-e85a-4ea8-9259-a468d17c9237 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:16.871475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f63a-e85a-4ea8-9259-a468d17c9237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:16.909283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-81b1f63a-e85a-4ea8-9259-a468d17c9237 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:16.911360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-81b1f63a-e85a-4ea8-9259-a468d17c9237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:16.935597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69966fd-18a2-4be8-b3a4-1844e67a82cd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.004282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23939b58-f300-47c3-8bc8-72854bc50186 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FH81q8GqSFevFk95B9cqnA, audit_chain_id=['FH81q8GqSFevFk95B9cqnA']) at 0x7fe8a14e1fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.005150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939b58-f300-47c3-8bc8-72854bc50186 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.005431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939b58-f300-47c3-8bc8-72854bc50186 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.005701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23939b58-f300-47c3-8bc8-72854bc50186 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.034085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23939b58-f300-47c3-8bc8-72854bc50186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-23939b58-f300-47c3-8bc8-72854bc50186 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:17.041856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:17.043824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:17.045669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 120/238] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:17.047292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e491-3dd3-4914-9593-7a1b5507cc71 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.047292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e491-3dd3-4914-9593-7a1b5507cc71 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.047292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f4e491-3dd3-4914-9593-7a1b5507cc71 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.053095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 121/239] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:40:17.053256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 119/240] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:17.053346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e491-3dd3-4914-9593-7a1b5507cc71 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.058528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.058822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.059101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.088585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:17.089927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:17.161968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f4e491-3dd3-4914-9593-7a1b5507cc71 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.189608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 120/241] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:17.191517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.208340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FH81q8GqSFevFk95B9cqnA, audit_chain_id=['FH81q8GqSFevFk95B9cqnA']) at 0x7fe8a14fafa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.209046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.209329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.209621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.210378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:17.210678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:17.212189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac7a8c-956c-4581-aa7a-3f47c2d52c52 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:17.238346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 122/242] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:17.240077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948cf83-52eb-4082-b62d-64b97b0af5de None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.240372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948cf83-52eb-4082-b62d-64b97b0af5de None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.240642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948cf83-52eb-4082-b62d-64b97b0af5de None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.242080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 123/243] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:17.243303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948cf83-52eb-4082-b62d-64b97b0af5de None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.318122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06374cab-c586-4e7a-9c72-cb9c3fb24e13 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.352440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948cf83-52eb-4082-b62d-64b97b0af5de None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.353912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_8PDdlGdSiaTZIlAb4do-g, audit_chain_id=['_8PDdlGdSiaTZIlAb4do-g']) at 0x7fe8a15575e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.354705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.355009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.355302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.367156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:17.375793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:17.377104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 121/244] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:17.378038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.397420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b99c2-0195-46d6-b750-903ae3cf241b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zX2igSijQ5-psqgUJ7MWEQ, audit_chain_id=['zX2igSijQ5-psqgUJ7MWEQ']) at 0x7fe8a14ff9d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.398216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b99c2-0195-46d6-b750-903ae3cf241b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.398498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b99c2-0195-46d6-b750-903ae3cf241b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.398769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b99c2-0195-46d6-b750-903ae3cf241b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.399933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b99c2-0195-46d6-b750-903ae3cf241b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:17.401408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b99c2-0195-46d6-b750-903ae3cf241b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:17.403701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 124/245] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:17.404876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.405185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.405457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.422005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:17.423101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:17.493910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fcda82-fb08-47e8-9734-46c5b37e8904 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.501132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 125/246] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:17.501132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.539975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FH81q8GqSFevFk95B9cqnA, audit_chain_id=['FH81q8GqSFevFk95B9cqnA']) at 0x7fe8a14e9fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.541123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.541556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.541975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] PATH_INFO: `/v3/users/065aa58cea354e5e8cf86187dbad2732` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.544097 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] RBAC: Authorizing `identity:get_user(user_id=065aa58cea354e5e8cf86187dbad2732)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:17.545757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:17.547868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 122/247] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/users/065aa58cea354e5e8cf86187dbad2732 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:17.548964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.625238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d3c6b-f4ac-409b-9447-5c7750efacdb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.658915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941e4e0e-ad89-4315-b145-47de146ce647 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.660303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_8PDdlGdSiaTZIlAb4do-g, audit_chain_id=['_8PDdlGdSiaTZIlAb4do-g']) at 0x7fe8a14e1700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.660973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.661272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.661542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.662296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:17.662591 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:17.663987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:17.673288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 126/248] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:17.674034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.697086 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zX2igSijQ5-psqgUJ7MWEQ, audit_chain_id=['zX2igSijQ5-psqgUJ7MWEQ']) at 0x7fe8a14e0f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.698057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.698518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.699659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.700580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:17.702102 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:17.723203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 123/249] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:17 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:17.741014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.785127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566ab40-dbb0-4341-8463-808d4a112afc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.822526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-SHfSjrFQnKzytStGlKVVQ, audit_chain_id=['-SHfSjrFQnKzytStGlKVVQ']) at 0x7fe8a1c5a4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.823333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.823635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.824450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:17.836499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:17.845047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:17.846044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:17.846841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:17.851209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 127/250] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:17.852268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:17.882675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d24f34-5d3c-4f66-996f-fc5dec0527f3 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:17.923603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FH81q8GqSFevFk95B9cqnA, audit_chain_id=['FH81q8GqSFevFk95B9cqnA']) at 0x7fe8a1997d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:17.923900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:17.924346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:17.924767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.000399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c52843f-d525-4e72-b5eb-a19008927b1d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.015773 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.017837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.047126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_8PDdlGdSiaTZIlAb4do-g, audit_chain_id=['_8PDdlGdSiaTZIlAb4do-g']) at 0x7fe8a1509550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.048022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.048297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.048564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] PATH_INFO: `/v3/users/469386ee912a47f698d0f5db50df1cdf` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.069843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] RBAC: Authorizing `identity:get_user(user_id=469386ee912a47f698d0f5db50df1cdf)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.071331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.079241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 128/251] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/users/469386ee912a47f698d0f5db50df1cdf => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.079957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.180026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 124/252] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:18.180623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.217116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a420f2-5ac5-4772-9e8c-b88d6fbb2b08 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.254183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-SHfSjrFQnKzytStGlKVVQ, audit_chain_id=['-SHfSjrFQnKzytStGlKVVQ']) at 0x7fe8a15078b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.254902 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.255188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.255459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.256228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:18.256788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.258168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.270893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 129/253] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.271768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.298612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162927-d595-474e-bfd7-8338ac0aba33 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.340677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7987c68-ac2e-413f-b7f4-eaa2134d1e71 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_8PDdlGdSiaTZIlAb4do-g, audit_chain_id=['_8PDdlGdSiaTZIlAb4do-g']) at 0x7fe8a1571f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.342024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7987c68-ac2e-413f-b7f4-eaa2134d1e71 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.342680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7987c68-ac2e-413f-b7f4-eaa2134d1e71 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.343283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7987c68-ac2e-413f-b7f4-eaa2134d1e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.399181 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb889a3-2b27-4553-89b9-147a76b0b70e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.423137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7987c68-ac2e-413f-b7f4-eaa2134d1e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.424623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7987c68-ac2e-413f-b7f4-eaa2134d1e71 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.436584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FH81q8GqSFevFk95B9cqnA, audit_chain_id=['FH81q8GqSFevFk95B9cqnA']) at 0x7fe8a14f7cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.437844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.438392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.438853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.440272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.441945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.443863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 130/254] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.444945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.539568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 125/255] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:18.540943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501027-cecc-4f00-8e9f-4fb3c0dbb52d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.541278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501027-cecc-4f00-8e9f-4fb3c0dbb52d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.541559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34501027-cecc-4f00-8e9f-4fb3c0dbb52d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.543594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 126/256] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:18.544349 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34501027-cecc-4f00-8e9f-4fb3c0dbb52d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.553727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227541a-cdd0-4027-b8cf-7004eb5c4906 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.590428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-SHfSjrFQnKzytStGlKVVQ, audit_chain_id=['-SHfSjrFQnKzytStGlKVVQ']) at 0x7fe8a14f0940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.591431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.591712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.591981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] PATH_INFO: `/v3/users/df515bdbf1f940ca8a2f281491c82e9a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.593854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] RBAC: Authorizing `identity:get_user(user_id=df515bdbf1f940ca8a2f281491c82e9a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.596207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.599171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 131/257] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/users/df515bdbf1f940ca8a2f281491c82e9a => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.600392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.677064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34501027-cecc-4f00-8e9f-4fb3c0dbb52d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.723053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FH81q8GqSFevFk95B9cqnA, audit_chain_id=['FH81q8GqSFevFk95B9cqnA']) at 0x7fe8a16041f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.724096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.724588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.725133 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.726731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=065aa58cea354e5e8cf86187dbad2732) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:18.727288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.730603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cba173-c50d-4ac5-9849-7be635b9a2fd None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.731366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3a818-04db-40d7-95a2-b2b0e2e73f4a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.745405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 127/258] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/role_assignments?user.id=065aa58cea354e5e8cf86187dbad2732&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.747465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.747754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.748029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.771907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_8PDdlGdSiaTZIlAb4do-g, audit_chain_id=['_8PDdlGdSiaTZIlAb4do-g']) at 0x7fe8a15230d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.772826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.773172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.773443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.774774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.776327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.778580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 132/259] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.779402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:18.786500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:18.787751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:18.900365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fced13-bb4e-4f5e-bd3e-c402f673bc21 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:18.945015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-SHfSjrFQnKzytStGlKVVQ, audit_chain_id=['-SHfSjrFQnKzytStGlKVVQ']) at 0x7fe8a158f220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:18.945015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:18.945015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:18.945015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:18.945432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:18.945786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:18.948213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 133/260] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:18.949395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:19.024538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 128/261] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:19.025340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:19.076718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ffa67-1beb-4f0c-80e7-629876e4ac6b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:19.112891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_8PDdlGdSiaTZIlAb4do-g, audit_chain_id=['_8PDdlGdSiaTZIlAb4do-g']) at 0x7fe8a14e5700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:19.113583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:19.113865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:19.114141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:19.114986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] RBAC: Adding query filter params (role.id=7d0ab02adc9a4f9598ba0d9ea150b834, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=469386ee912a47f698d0f5db50df1cdf) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:19.115298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:19.116755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:19.122750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 134/262] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:18 2022] GET /identity/v3/role_assignments?user.id=469386ee912a47f698d0f5db50df1cdf&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=7d0ab02adc9a4f9598ba0d9ea150b834 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:19.123580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:19.140970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218879f-59f3-4100-b007-6119b04f0eea None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:19.183590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=-SHfSjrFQnKzytStGlKVVQ, audit_chain_id=['-SHfSjrFQnKzytStGlKVVQ']) at 0x7fe8a14ea160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:19.184506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:19.184785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:19.185083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/df515bdbf1f940ca8a2f281491c82e9a/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:19.187109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user_id=df515bdbf1f940ca8a2f281491c82e9a, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:19.188579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:19.221899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 129/263] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:19 2022] PUT /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/df515bdbf1f940ca8a2f281491c82e9a/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:19.252861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fd198-4daf-4052-87ed-6edb2a8df755 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:19.296321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OIi0okjLTbyz43TdjlBDAg, audit_chain_id=['OIi0okjLTbyz43TdjlBDAg']) at 0x7fe8a155eeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:19.297875 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:19.298235 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:19.298513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:19.311804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:19.321050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:19.322531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:19.325167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 135/264] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:19.331797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:19.468824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1103b-9c11-404d-bcf8-d0bca5e33668 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:19.514489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OIi0okjLTbyz43TdjlBDAg, audit_chain_id=['OIi0okjLTbyz43TdjlBDAg']) at 0x7fe8a16041f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:19.515172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:19.515455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:19.515729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:19.516486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:19.516790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:19.518196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:19.527203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 130/265] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:19.533781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:19.647532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5273c1b-164c-424f-b7cf-333ab1dc8982 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:19.681935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OIi0okjLTbyz43TdjlBDAg, audit_chain_id=['OIi0okjLTbyz43TdjlBDAg']) at 0x7fe8a1490a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:19.682813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:19.683155 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:19.683942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] PATH_INFO: `/v3/users/065aa58cea354e5e8cf86187dbad2732` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:19.685184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] RBAC: Authorizing `identity:get_user(user_id=065aa58cea354e5e8cf86187dbad2732)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:19.686632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:19.688575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 136/266] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:19 2022] GET /identity/v3/users/065aa58cea354e5e8cf86187dbad2732 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:19.694031 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:19.841618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedade9c-d89d-4458-b7ea-9cfe9128ad41 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:19.875241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OIi0okjLTbyz43TdjlBDAg, audit_chain_id=['OIi0okjLTbyz43TdjlBDAg']) at 0x7fe8a14d11f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:19.875895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:19.876176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:19.876449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:19.967972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:19.969400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:20.069930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 131/267] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:20.076483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:20.221227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de695fd-cd1d-41ff-a6bf-1ba9d6f059bc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:20.262947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94802da-a393-48e5-847d-80a2c0881e94 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OIi0okjLTbyz43TdjlBDAg, audit_chain_id=['OIi0okjLTbyz43TdjlBDAg']) at 0x7fe8a150a250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:20.263827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94802da-a393-48e5-847d-80a2c0881e94 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:20.264107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94802da-a393-48e5-847d-80a2c0881e94 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:20.264382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94802da-a393-48e5-847d-80a2c0881e94 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:20.265644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94802da-a393-48e5-847d-80a2c0881e94 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:20.267121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94802da-a393-48e5-847d-80a2c0881e94 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:20.269200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 137/268] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:20 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:20.275909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:20.411253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507bc1e-b25d-4472-9d7b-259c35b7f21f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:20.452776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OIi0okjLTbyz43TdjlBDAg, audit_chain_id=['OIi0okjLTbyz43TdjlBDAg']) at 0x7fe8a1517df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:20.453922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:20.454411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:20.454898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:20.456469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] RBAC: Adding query filter params (role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=065aa58cea354e5e8cf86187dbad2732) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:20.457056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:20.459823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9d1002-218c-4426-b5fa-473103b26de2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:20.475174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 132/269] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:20 2022] GET /identity/v3/role_assignments?user.id=065aa58cea354e5e8cf86187dbad2732&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:20.815580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3cc2f-809f-4972-81aa-54b199f46e55 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:20.816234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3cc2f-809f-4972-81aa-54b199f46e55 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:20.816724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3cc2f-809f-4972-81aa-54b199f46e55 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:20.818636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 138/270] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:20.824026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a00b9-0176-43f0-bccc-5ef29af8511a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:20.824609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a00b9-0176-43f0-bccc-5ef29af8511a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:20.824609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a00b9-0176-43f0-bccc-5ef29af8511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:20.842522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f44a00b9-0176-43f0-bccc-5ef29af8511a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:20.844054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f44a00b9-0176-43f0-bccc-5ef29af8511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:20.918861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 133/271] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:20.926669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962701-6d7a-4062-aede-1128184734ed None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:20.927210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962701-6d7a-4062-aede-1128184734ed None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:20.927684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962701-6d7a-4062-aede-1128184734ed None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:20.929475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 139/272] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:20.935716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:20.936351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:20.936823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:20.946196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72962701-6d7a-4062-aede-1128184734ed None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:20.959842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:20.961610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:21.058996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 134/273] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:21.084658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:21.092650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72962701-6d7a-4062-aede-1128184734ed None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:21.130691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ALIguUCYRSy-nqNo6daxRg, audit_chain_id=['ALIguUCYRSy-nqNo6daxRg']) at 0x7fe8a14ee850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:21.131878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.132361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.132849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.134376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:21.136848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:21.139827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 140/274] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:21.145394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:21.207588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4d298-f753-4473-8aa8-beb2f1832822 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:21.253269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur31U-qQRCSGIXalQ60V2w, audit_chain_id=['Ur31U-qQRCSGIXalQ60V2w']) at 0x7fe8a1531820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:21.254937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.255464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.256138 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.270468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e006cc-372e-4a45-8260-ff5a04eca383 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:21.273726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:21.285361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:21.286327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:21.287123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:21.295299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 135/275] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:21.296348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:21.321425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ALIguUCYRSy-nqNo6daxRg, audit_chain_id=['ALIguUCYRSy-nqNo6daxRg']) at 0x7fe8a158cf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:21.322206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.322484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.322753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.323521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:21.325689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:21.353153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 141/276] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:21 2022] POST /identity/v3/users => generated 293 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:40:21.443328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c63d5a-0a53-4071-a8c9-4b284fefd79b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:21.488843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur31U-qQRCSGIXalQ60V2w, audit_chain_id=['Ur31U-qQRCSGIXalQ60V2w']) at 0x7fe8a14e9670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:21.489567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.489850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.490132 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.490910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:21.491221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:21.492636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:21.503145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 136/277] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:21.510049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:21.621649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4515a4-c456-4df2-9b52-d93b059c4e9b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:21.657941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223db91-d751-433a-b0b6-5b76decf0c91 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur31U-qQRCSGIXalQ60V2w, audit_chain_id=['Ur31U-qQRCSGIXalQ60V2w']) at 0x7fe8a14dafd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:21.659287 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223db91-d751-433a-b0b6-5b76decf0c91 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.659796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223db91-d751-433a-b0b6-5b76decf0c91 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.660302 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223db91-d751-433a-b0b6-5b76decf0c91 None admin] PATH_INFO: `/v3/users/aa008854d42e4f4a9e08a47cd1da1508` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.677629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223db91-d751-433a-b0b6-5b76decf0c91 None admin] RBAC: Authorizing `identity:get_user(user_id=aa008854d42e4f4a9e08a47cd1da1508)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:21.679601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223db91-d751-433a-b0b6-5b76decf0c91 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:21.682063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 142/278] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:21 2022] GET /identity/v3/users/aa008854d42e4f4a9e08a47cd1da1508 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:21.688822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:21.801138 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4da555-a382-4aa4-a495-7b0cb5bd1d93 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:21.842540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Ur31U-qQRCSGIXalQ60V2w, audit_chain_id=['Ur31U-qQRCSGIXalQ60V2w']) at 0x7fe8a1529940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:21.844005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.844508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.845001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.846067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, user.id=aa008854d42e4f4a9e08a47cd1da1508, scope.system=all) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:21.846580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:21.848256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c75f5a-2008-435a-b92b-4e15c681bc13 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:21.854424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 137/279] 10.222.0.49 () {56 vars in 1308 bytes} [Fri May 13 12:40:21 2022] GET /identity/v3/role_assignments?user.id=aa008854d42e4f4a9e08a47cd1da1508&scope.system=all&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:21.912935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ae76-e46e-440f-8462-3fb385885a96 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.913613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ae76-e46e-440f-8462-3fb385885a96 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.914085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b8ae76-e46e-440f-8462-3fb385885a96 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.915954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 143/280] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:21.923553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b037-e1a3-4654-a88f-bc0bd9bec2da None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:21.924176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b037-e1a3-4654-a88f-bc0bd9bec2da None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:21.924670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7086b037-e1a3-4654-a88f-bc0bd9bec2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:21.944016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-7086b037-e1a3-4654-a88f-bc0bd9bec2da None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:21.945628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7086b037-e1a3-4654-a88f-bc0bd9bec2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:22.062645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 138/281] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:22.087104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8ae76-e46e-440f-8462-3fb385885a96 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.200537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b8ae76-e46e-440f-8462-3fb385885a96 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:22.237543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Uo2WWFk8TQaeb523G4FudQ, audit_chain_id=['Uo2WWFk8TQaeb523G4FudQ']) at 0x7fe8a14d3460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:22.238772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.239251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.239719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.250361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000644e2-12dd-45ab-98b5-0649745c90eb None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.250963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000644e2-12dd-45ab-98b5-0649745c90eb None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.251471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000644e2-12dd-45ab-98b5-0649745c90eb None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.253053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 139/282] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:40:22.257485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:22.258776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.259068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.259344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:22.267579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:22.268886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:22.269828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:22.272712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 144/283] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:22.278696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.278847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:22.280071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:22.381426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454efbf-7211-4e91-92f8-c31068ae5a21 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:22.410915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 140/284] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:22.417813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Uo2WWFk8TQaeb523G4FudQ, audit_chain_id=['Uo2WWFk8TQaeb523G4FudQ']) at 0x7fe8a14a32e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:22.418979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.419462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.419930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.420898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:22.421421 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:22.423005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:22.432283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 145/285] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:22.438660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.447797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.628139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890fafc-32b4-4453-b5e0-9125b28f5042 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:22.632974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cfacf-3669-4ac6-bff6-a48e15de3148 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:22.694170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nxxgvj7tR2OTzrdXrnImkA, audit_chain_id=['Nxxgvj7tR2OTzrdXrnImkA']) at 0x7fe8a14fac70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:22.694973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.695251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.695522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.699241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Uo2WWFk8TQaeb523G4FudQ, audit_chain_id=['Uo2WWFk8TQaeb523G4FudQ']) at 0x7fe8a1524a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:22.700222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.700499 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.700761 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] PATH_INFO: `/v3/users/469386ee912a47f698d0f5db50df1cdf` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.702877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] RBAC: Authorizing `identity:get_user(user_id=469386ee912a47f698d0f5db50df1cdf)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:22.706681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:22.713903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 141/286] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:22 2022] GET /identity/v3/users/469386ee912a47f698d0f5db50df1cdf => generated 297 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:22.717295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.724558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:22.738836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:22.740434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:22.741896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 146/287] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:22.750266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.877341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70bbcc-5662-45e2-afcf-2e0d56feacc4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:22.916915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Uo2WWFk8TQaeb523G4FudQ, audit_chain_id=['Uo2WWFk8TQaeb523G4FudQ']) at 0x7fe8a1528ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:22.918385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.918665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.918924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.921115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:22.922562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:22.924259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 142/288] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:22 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:22.932841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:22.937959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4a3ac-b560-4de5-a946-85d379ca33ed None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:22.988351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nxxgvj7tR2OTzrdXrnImkA, audit_chain_id=['Nxxgvj7tR2OTzrdXrnImkA']) at 0x7fe8a1490c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:22.989370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:22.989866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:22.990329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:22.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:22.991780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:22.993375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:23.002471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 147/289] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:23.008326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:23.141516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a9099-574e-4e44-8cab-593d967026e3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:23.185309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nxxgvj7tR2OTzrdXrnImkA, audit_chain_id=['Nxxgvj7tR2OTzrdXrnImkA']) at 0x7fe8a1490580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:23.186663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:23.187391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:23.187886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] PATH_INFO: `/v3/users/df515bdbf1f940ca8a2f281491c82e9a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:23.189473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] RBAC: Authorizing `identity:get_user(user_id=df515bdbf1f940ca8a2f281491c82e9a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:23.191222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:23.193176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 148/290] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:23 2022] GET /identity/v3/users/df515bdbf1f940ca8a2f281491c82e9a => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:23.201460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:23.202166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ab02-91f6-4b59-84e3-55e88e23f77b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:23.242741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Uo2WWFk8TQaeb523G4FudQ, audit_chain_id=['Uo2WWFk8TQaeb523G4FudQ']) at 0x7fe8a1571520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:23.244337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:23.244839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:23.245385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/469386ee912a47f698d0f5db50df1cdf/roles/7d0ab02adc9a4f9598ba0d9ea150b834` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:23.253812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user_id=469386ee912a47f698d0f5db50df1cdf, role_id=7d0ab02adc9a4f9598ba0d9ea150b834)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:23.255309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:23.277824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 143/291] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:40:22 2022] PUT /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/users/469386ee912a47f698d0f5db50df1cdf/roles/7d0ab02adc9a4f9598ba0d9ea150b834 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:23.390395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8528cc4-248a-47ba-88e7-85eaa3601a1f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:23.446661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nxxgvj7tR2OTzrdXrnImkA, audit_chain_id=['Nxxgvj7tR2OTzrdXrnImkA']) at 0x7fe8a14e5190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:23.447257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:23.447540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:23.447816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:23.535706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:23.537461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:23.648183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 149/292] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:23.654382 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:23.773227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa26d7b-8190-4807-94ac-521339212f68 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:23.810537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e599148-903a-4568-a051-e9b039951e91 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nxxgvj7tR2OTzrdXrnImkA, audit_chain_id=['Nxxgvj7tR2OTzrdXrnImkA']) at 0x7fe8a1524d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:23.811415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599148-903a-4568-a051-e9b039951e91 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:23.811698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599148-903a-4568-a051-e9b039951e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:23.811978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e599148-903a-4568-a051-e9b039951e91 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:23.813255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e599148-903a-4568-a051-e9b039951e91 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:23.814749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e599148-903a-4568-a051-e9b039951e91 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:23.816804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 144/293] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:23 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:23.823241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:23.956520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8afa2-ca6b-4c3a-b964-8a76e4d5d901 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:24.037127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nxxgvj7tR2OTzrdXrnImkA, audit_chain_id=['Nxxgvj7tR2OTzrdXrnImkA']) at 0x7fe8a158c5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:24.038067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.038621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.039098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.040655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=df515bdbf1f940ca8a2f281491c82e9a) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:24.041206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:24.047769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18eed9-d070-4489-8a23-9407810640ab None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:24.059228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 150/294] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:23 2022] GET /identity/v3/role_assignments?user.id=df515bdbf1f940ca8a2f281491c82e9a&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:24.494319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ca8a7-4672-4cb1-a12e-98fe51319676 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.494866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ca8a7-4672-4cb1-a12e-98fe51319676 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.494866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ca8a7-4672-4cb1-a12e-98fe51319676 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.497408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 145/295] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:24.502729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd357fa-cfd2-417c-acce-76f6d4ec68a6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.503241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd357fa-cfd2-417c-acce-76f6d4ec68a6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.503241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd357fa-cfd2-417c-acce-76f6d4ec68a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.522952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9fd357fa-cfd2-417c-acce-76f6d4ec68a6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:24.524122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9fd357fa-cfd2-417c-acce-76f6d4ec68a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:24.608799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 151/296] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:24.620820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f09b3-0f73-4abc-9d88-c5c747346f67 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.621347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f09b3-0f73-4abc-9d88-c5c747346f67 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.621781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f09b3-0f73-4abc-9d88-c5c747346f67 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.623278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 146/297] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:24.628830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cabfa-c086-45eb-8944-2f6a00910d32 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.629438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cabfa-c086-45eb-8944-2f6a00910d32 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.629864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cabfa-c086-45eb-8944-2f6a00910d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.631517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f09b3-0f73-4abc-9d88-c5c747346f67 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:24.648891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9a8cabfa-c086-45eb-8944-2f6a00910d32 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:24.650095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a8cabfa-c086-45eb-8944-2f6a00910d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:24.720440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 152/298] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:24.721935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187f6ba-67c6-455e-a5a3-4ef1fd6c34d8 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.724080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187f6ba-67c6-455e-a5a3-4ef1fd6c34d8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.724080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187f6ba-67c6-455e-a5a3-4ef1fd6c34d8 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.724080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 153/299] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:24.731099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.731099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.731099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.743652 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f09b3-0f73-4abc-9d88-c5c747346f67 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:24.749070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:24.750192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:24.778408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pQZ0kWxmQKm8eduq8B6sRw, audit_chain_id=['pQZ0kWxmQKm8eduq8B6sRw']) at 0x7fe8a14d7f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:24.779192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.779475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.779749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.789702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:24.797995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:24.798973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:24.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 147/300] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:24.801807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:24.823561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 154/301] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:24.825385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:24.919247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b2409-db6f-48c2-bf00-17620ae0fa3a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:24.928506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8219b419-a238-4264-9ab5-1d690ba32e27 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:24.953614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q7UbdPelSViLQhGMoUx2Pw, audit_chain_id=['q7UbdPelSViLQhGMoUx2Pw']) at 0x7fe8a14fbc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:24.954414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.954709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.954977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.956164 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:24.957659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:24.959512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 148/302] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:24.960294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:24.967639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pQZ0kWxmQKm8eduq8B6sRw, audit_chain_id=['pQZ0kWxmQKm8eduq8B6sRw']) at 0x7fe8a1549790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:24.968559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:24.969011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:24.969421 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:24.970561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:24.971012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:24.973418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:24.982964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 155/303] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:24.983784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:25.076418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a62115-8e8d-4a79-9075-8c0c0cb97a4b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.084286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5718e3-1c37-4b41-b146-7088296bc77f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.110015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k_cslUPbREqNgrdIUIpRaA, audit_chain_id=['k_cslUPbREqNgrdIUIpRaA']) at 0x7fe8a14eab80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.110812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.111091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.111365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.118361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=q7UbdPelSViLQhGMoUx2Pw, audit_chain_id=['q7UbdPelSViLQhGMoUx2Pw']) at 0x7fe8a14e1e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.119031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.119309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.119583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] PATH_INFO: `/v3/groups` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.120269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:25.121730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:25.121861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:25.129220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:25.130191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:25.130974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:25.133778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 149/304] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:25.134894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:25.136446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 156/305] 10.222.0.49 () {60 vars in 1134 bytes} [Fri May 13 12:40:24 2022] POST /identity/v3/groups => generated 229 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:25.137266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:25.248683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809c9b8-5d81-455b-8124-75005bd25856 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.259441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e995708e-93de-4a43-ad9f-cf60bc4f31fd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.292080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k_cslUPbREqNgrdIUIpRaA, audit_chain_id=['k_cslUPbREqNgrdIUIpRaA']) at 0x7fe8a157ca30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.292795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.292970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.293370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.294182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:25.294490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:25.295913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:25.304665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pQZ0kWxmQKm8eduq8B6sRw, audit_chain_id=['pQZ0kWxmQKm8eduq8B6sRw']) at 0x7fe8a14ea370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.305051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 157/306] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:25.306140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.306627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.307126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] PATH_INFO: `/v3/users/aa008854d42e4f4a9e08a47cd1da1508` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.309586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] RBAC: Authorizing `identity:get_user(user_id=aa008854d42e4f4a9e08a47cd1da1508)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:25.311305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:25.311879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:25.313968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 150/307] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:25 2022] GET /identity/v3/users/aa008854d42e4f4a9e08a47cd1da1508 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:25.322677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:25.436451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f622d77-5761-4713-b9d9-39924c604963 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.441103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53e021e-3898-4015-88ec-c7a21103c13d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.476195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5d9bd-9c67-4a61-99f1-08636070280d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pQZ0kWxmQKm8eduq8B6sRw, audit_chain_id=['pQZ0kWxmQKm8eduq8B6sRw']) at 0x7fe8a14d77f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.477244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k_cslUPbREqNgrdIUIpRaA, audit_chain_id=['k_cslUPbREqNgrdIUIpRaA']) at 0x7fe8a14d3940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.477815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d9bd-9c67-4a61-99f1-08636070280d None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.478110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.478389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.478661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] PATH_INFO: `/v3/users/fea9f3812d5c4d629fe61edf8d1db6d0` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.478943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d9bd-9c67-4a61-99f1-08636070280d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.479590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5d9bd-9c67-4a61-99f1-08636070280d None admin] PATH_INFO: `/v3/system/users/aa008854d42e4f4a9e08a47cd1da1508/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.482458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d9bd-9c67-4a61-99f1-08636070280d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=aa008854d42e4f4a9e08a47cd1da1508, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:25.484078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5d9bd-9c67-4a61-99f1-08636070280d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:25.495391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] RBAC: Authorizing `identity:get_user(user_id=fea9f3812d5c4d629fe61edf8d1db6d0)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:25.496539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 151/308] 10.222.0.49 () {58 vars in 1334 bytes} [Fri May 13 12:40:25 2022] PUT /identity/v3/system/users/aa008854d42e4f4a9e08a47cd1da1508/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:25.503837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:25.503837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 158/309] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:25 2022] GET /identity/v3/users/fea9f3812d5c4d629fe61edf8d1db6d0 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:25.504929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:25.617305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000364af-a9f0-4304-aa1e-391020dacb2a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:25.659323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k_cslUPbREqNgrdIUIpRaA, audit_chain_id=['k_cslUPbREqNgrdIUIpRaA']) at 0x7fe8a14e1ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:25.660383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.660865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.661379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.662445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] RBAC: Adding query filter params (role.id=7d0ab02adc9a4f9598ba0d9ea150b834, user.id=fea9f3812d5c4d629fe61edf8d1db6d0, scope.system=all) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:25.662988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:25.664741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36dc39d-1147-4751-ad30-faccbeefc30f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:25.672297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 159/310] 10.222.0.49 () {56 vars in 1308 bytes} [Fri May 13 12:40:25 2022] GET /identity/v3/role_assignments?user.id=fea9f3812d5c4d629fe61edf8d1db6d0&scope.system=all&role.id=7d0ab02adc9a4f9598ba0d9ea150b834 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:25.975730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b1035-5835-4956-9b30-626c21df799a None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.976080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b1035-5835-4956-9b30-626c21df799a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.976361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965b1035-5835-4956-9b30-626c21df799a None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:25.977857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 152/311] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:25.984090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:25.984378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:25.984653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:26.001651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:26.002819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:26.083180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 160/312] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:26.113660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b1035-5835-4956-9b30-626c21df799a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:26.221727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965b1035-5835-4956-9b30-626c21df799a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:26.255761 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g9Q4b_sqQA-MME6_OgR2BA, audit_chain_id=['g9Q4b_sqQA-MME6_OgR2BA']) at 0x7fe8a14e4280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:26.256547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:26.256825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:26.257122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:26.268421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:26.275981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:26.276917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:26.277789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:26.281712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 153/313] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:26.283664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:26.384669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d3895-10f8-440f-881d-7d1263770d67 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:26.423900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g9Q4b_sqQA-MME6_OgR2BA, audit_chain_id=['g9Q4b_sqQA-MME6_OgR2BA']) at 0x7fe8a14e8af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:26.424598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:26.424882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:26.425209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:26.425990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:26.426422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:26.428082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:26.439882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 161/314] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:26.445311 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:26.549331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c388f-1ffe-4b89-a6c1-a8190e5344e0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:26.582383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g9Q4b_sqQA-MME6_OgR2BA, audit_chain_id=['g9Q4b_sqQA-MME6_OgR2BA']) at 0x7fe8a14fb550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:26.583240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:26.583515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:26.583783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] PATH_INFO: `/v3/users/469386ee912a47f698d0f5db50df1cdf` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:26.584962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] RBAC: Authorizing `identity:get_user(user_id=469386ee912a47f698d0f5db50df1cdf)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:26.586413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:26.593097 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 154/315] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:26 2022] GET /identity/v3/users/469386ee912a47f698d0f5db50df1cdf => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:26.594879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:26.693887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe4192-754f-4ef4-8ee9-4ad043f62c85 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:26.729977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g9Q4b_sqQA-MME6_OgR2BA, audit_chain_id=['g9Q4b_sqQA-MME6_OgR2BA']) at 0x7fe8a1838190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:26.730987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:26.731274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:26.731552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:26.802288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:26.803721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:26.909019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 162/316] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:26.914553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:27.018358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e09bd-aadb-416c-93b2-914729d5c51f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:27.052043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990b2cc-dd49-48e3-8dc6-281c872bef0a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g9Q4b_sqQA-MME6_OgR2BA, audit_chain_id=['g9Q4b_sqQA-MME6_OgR2BA']) at 0x7fe8a1491c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:27.053060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990b2cc-dd49-48e3-8dc6-281c872bef0a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.053293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990b2cc-dd49-48e3-8dc6-281c872bef0a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.053562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990b2cc-dd49-48e3-8dc6-281c872bef0a None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.054846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990b2cc-dd49-48e3-8dc6-281c872bef0a None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:27.056273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990b2cc-dd49-48e3-8dc6-281c872bef0a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:27.063353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 155/317] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:26 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:27.064674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:27.162941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984aec9e-9638-4e0f-9513-129d6cd49ca4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:27.199822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g9Q4b_sqQA-MME6_OgR2BA, audit_chain_id=['g9Q4b_sqQA-MME6_OgR2BA']) at 0x7fe8a155f520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:27.200483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.200765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.201059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.201890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] RBAC: Adding query filter params (role.id=7d0ab02adc9a4f9598ba0d9ea150b834, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c, user.id=469386ee912a47f698d0f5db50df1cdf) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:27.202198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:27.203622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b76ff2e-f99f-4076-8d29-f7db788e933e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:27.210038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 163/318] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:27 2022] GET /identity/v3/role_assignments?user.id=469386ee912a47f698d0f5db50df1cdf&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=7d0ab02adc9a4f9598ba0d9ea150b834 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:27.626671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df468-56d8-4524-8aa9-f39445e31985 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.627185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df468-56d8-4524-8aa9-f39445e31985 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.627258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df468-56d8-4524-8aa9-f39445e31985 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.628739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 156/319] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:27.633978 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d8c34-6d14-41a3-bf5d-b36007e010f6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.634406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d8c34-6d14-41a3-bf5d-b36007e010f6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.634545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d8c34-6d14-41a3-bf5d-b36007e010f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.652359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-568d8c34-6d14-41a3-bf5d-b36007e010f6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:27.653580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-568d8c34-6d14-41a3-bf5d-b36007e010f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:27.722743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 164/320] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:27.744936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df468-56d8-4524-8aa9-f39445e31985 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:27.865063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30f8d6-9699-4d62-9c98-8c7c04cb8b10 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.865397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30f8d6-9699-4d62-9c98-8c7c04cb8b10 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.865616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30f8d6-9699-4d62-9c98-8c7c04cb8b10 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.867129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 165/321] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:40:27.872030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df6c03-15ee-4633-88a9-ba39aa10ba89 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.872310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df6c03-15ee-4633-88a9-ba39aa10ba89 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.872579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df6c03-15ee-4633-88a9-ba39aa10ba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.875667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df468-56d8-4524-8aa9-f39445e31985 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:27.889877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c9df6c03-15ee-4633-88a9-ba39aa10ba89 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:27.890986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c9df6c03-15ee-4633-88a9-ba39aa10ba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:27.910934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bZE_XPqtRlmgzk26MIRb2A, audit_chain_id=['bZE_XPqtRlmgzk26MIRb2A']) at 0x7fe8a14d19d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:27.912019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.912019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.912293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.913458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:27.914888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:27.921359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 157/322] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:27.922291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:27.960268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 166/323] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:27.961837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa312-8535-43e8-9276-984ae077b2ee None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.962275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa312-8535-43e8-9276-984ae077b2ee None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.962558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6aa312-8535-43e8-9276-984ae077b2ee None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.963817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 167/324] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:27.970887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:27.971285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:27.971709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:27.988324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:27.989534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:28.025569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaef059-40c4-4059-af04-386f2be5f924 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.054783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 168/325] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:28.055621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.056971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bZE_XPqtRlmgzk26MIRb2A, audit_chain_id=['bZE_XPqtRlmgzk26MIRb2A']) at 0x7fe8a154c190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.057661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.058452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.058730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] PATH_INFO: `/v3/groups` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.059408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.060838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.077339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 158/326] 10.222.0.49 () {60 vars in 1134 bytes} [Fri May 13 12:40:27 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:28.080196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.173798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c22fabe-ecc6-445d-85c7-8fcbfd13f73d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.195922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e9449-3cd1-45d0-adb4-d40c99779766 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.215028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JFiIj8AETdCTUwmtWXkaPQ, audit_chain_id=['JFiIj8AETdCTUwmtWXkaPQ']) at 0x7fe8a14e5190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.215882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.216173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.216464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.228751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:28.236732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:28.237844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:28.238643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 169/327] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:28.244278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.247000 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NqTlX6qvS6KwBjKVLbi68w, audit_chain_id=['NqTlX6qvS6KwBjKVLbi68w']) at 0x7fe8a1529e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.247821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.248099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.248371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.262531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:28.270387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:28.271294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:28.272078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 159/328] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:28.277589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.355277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203e42-7813-4421-ac52-e3d1528ad9d9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.382752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad038d-754c-498d-b715-5639f9bdca2a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.390221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JFiIj8AETdCTUwmtWXkaPQ, audit_chain_id=['JFiIj8AETdCTUwmtWXkaPQ']) at 0x7fe8a14a3a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.391211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.391706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.392204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.393169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:28.393665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.395490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.411102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 170/329] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:28.412763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.419075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NqTlX6qvS6KwBjKVLbi68w, audit_chain_id=['NqTlX6qvS6KwBjKVLbi68w']) at 0x7fe8a14fb790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.419755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.420041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.420428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.421197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] RBAC: Adding query filter params (name=reader) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:28.421504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.422907 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.432846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 160/330] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:28.439153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.533574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095cc8-8096-463c-8d3c-2c54d88d2cde None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.546079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4f608-f0e3-4b14-89b5-ab34db6f113d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.568094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JFiIj8AETdCTUwmtWXkaPQ, audit_chain_id=['JFiIj8AETdCTUwmtWXkaPQ']) at 0x7fe8a14fb3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.568962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.569267 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.569534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] PATH_INFO: `/v3/users/aa008854d42e4f4a9e08a47cd1da1508` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.570771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] RBAC: Authorizing `identity:get_user(user_id=aa008854d42e4f4a9e08a47cd1da1508)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.572214 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.574771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 171/331] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/users/aa008854d42e4f4a9e08a47cd1da1508 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:28.581394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.583896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NqTlX6qvS6KwBjKVLbi68w, audit_chain_id=['NqTlX6qvS6KwBjKVLbi68w']) at 0x7fe8a14ea190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.584845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.585170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.585426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] PATH_INFO: `/v3/users/fea9f3812d5c4d629fe61edf8d1db6d0` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.586663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] RBAC: Authorizing `identity:get_user(user_id=fea9f3812d5c4d629fe61edf8d1db6d0)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.588187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.590980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 161/332] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/users/fea9f3812d5c4d629fe61edf8d1db6d0 => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:28.597488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:28.690761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f018f-a855-4416-b52e-c576e57b3bca None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.713475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e2f4bb-c150-45d3-8c25-8fcb8d99834d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:28.726587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JFiIj8AETdCTUwmtWXkaPQ, audit_chain_id=['JFiIj8AETdCTUwmtWXkaPQ']) at 0x7fe8a14e4880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.727251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.727530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.727802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.728631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] RBAC: Adding query filter params (role.id=fa930edb07634faa8c2c98410f8403d6, user.id=aa008854d42e4f4a9e08a47cd1da1508, scope.system=all) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:28.728941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.731093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c930f232-cdc6-45e1-9d31-0314b9935c41 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.743930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 172/333] 10.222.0.49 () {56 vars in 1308 bytes} [Fri May 13 12:40:28 2022] GET /identity/v3/role_assignments?user.id=aa008854d42e4f4a9e08a47cd1da1508&scope.system=all&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:28.751298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d737918-0f8e-4784-947b-aff663fbb731 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NqTlX6qvS6KwBjKVLbi68w, audit_chain_id=['NqTlX6qvS6KwBjKVLbi68w']) at 0x7fe8a14dabe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:28.752189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d737918-0f8e-4784-947b-aff663fbb731 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:28.752474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d737918-0f8e-4784-947b-aff663fbb731 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:28.752753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d737918-0f8e-4784-947b-aff663fbb731 None admin] PATH_INFO: `/v3/system/users/fea9f3812d5c4d629fe61edf8d1db6d0/roles/7d0ab02adc9a4f9598ba0d9ea150b834` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:28.754342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d737918-0f8e-4784-947b-aff663fbb731 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fea9f3812d5c4d629fe61edf8d1db6d0, role_id=7d0ab02adc9a4f9598ba0d9ea150b834)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:28.755753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d737918-0f8e-4784-947b-aff663fbb731 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:28.769824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 162/334] 10.222.0.49 () {58 vars in 1334 bytes} [Fri May 13 12:40:28 2022] PUT /identity/v3/system/users/fea9f3812d5c4d629fe61edf8d1db6d0/roles/7d0ab02adc9a4f9598ba0d9ea150b834 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:40:30.841808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6963a-9471-4304-9e7e-696424f709eb None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:30.842823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6963a-9471-4304-9e7e-696424f709eb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:30.843299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6963a-9471-4304-9e7e-696424f709eb None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:30.845134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 173/335] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:30.851611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:30.852454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:30.852969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:30.878018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:30.879570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:30.963451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 163/336] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:31.028804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6963a-9471-4304-9e7e-696424f709eb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:31.162316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6963a-9471-4304-9e7e-696424f709eb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:31.203844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590dc91-9686-457e-8b9d-026850180487 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HkVFKX6XR6qF1T7P72emLw, audit_chain_id=['HkVFKX6XR6qF1T7P72emLw']) at 0x7fe8a14daee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:31.204659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dc91-9686-457e-8b9d-026850180487 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.204933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dc91-9686-457e-8b9d-026850180487 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.205230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590dc91-9686-457e-8b9d-026850180487 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.225899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590dc91-9686-457e-8b9d-026850180487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-2590dc91-9686-457e-8b9d-026850180487 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:31.234713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:31.235595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:31.236370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:31.238428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 174/337] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:31.243313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:31.294058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b7b3-6041-4ad2-9181-618d2f98fd8e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.294681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b7b3-6041-4ad2-9181-618d2f98fd8e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.295150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4b7b3-6041-4ad2-9181-618d2f98fd8e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.299498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 175/338] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:31.317008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.317008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.317008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.350243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:31.351757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:31.388966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd07c62-717d-48f6-8dbb-64a21679365f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:31.442405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HkVFKX6XR6qF1T7P72emLw, audit_chain_id=['HkVFKX6XR6qF1T7P72emLw']) at 0x7fe8a154c1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:31.443437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.443926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.444405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.445399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:31.445913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:31.447484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:31.461604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 176/339] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:31.463302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 164/340] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:31.469728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:31.485480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:31.672873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b545f-e850-4c10-bc81-ec3db1bc2adb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:31.675772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc884d-2885-465a-92bc-d264aa8c863d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:31.731411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc47dff-e7db-4515-a64b-5697063d3ac5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IJY7XKn9Rl6-JMz8nKbDvA, audit_chain_id=['IJY7XKn9Rl6-JMz8nKbDvA']) at 0x7fe8a154c190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:31.732134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47dff-e7db-4515-a64b-5697063d3ac5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.732412 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47dff-e7db-4515-a64b-5697063d3ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.732685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc47dff-e7db-4515-a64b-5697063d3ac5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.733976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ecf30-168a-440a-b67a-a5b2988baabb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HkVFKX6XR6qF1T7P72emLw, audit_chain_id=['HkVFKX6XR6qF1T7P72emLw']) at 0x7fe8a1505e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:31.734618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ecf30-168a-440a-b67a-a5b2988baabb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.734896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ecf30-168a-440a-b67a-a5b2988baabb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.735164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ecf30-168a-440a-b67a-a5b2988baabb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.755428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc47dff-e7db-4515-a64b-5697063d3ac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-acc47dff-e7db-4515-a64b-5697063d3ac5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:31.764541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:31.765442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:31.766213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:31.766805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 165/341] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:31.768032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f404c-86d7-434d-bc52-754f74015407 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:31.768317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f404c-86d7-434d-bc52-754f74015407 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:31.768755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f404c-86d7-434d-bc52-754f74015407 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:31.770543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 166/342] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:31.771571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f404c-86d7-434d-bc52-754f74015407 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:31.868384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ecf30-168a-440a-b67a-a5b2988baabb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:31.869889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ecf30-168a-440a-b67a-a5b2988baabb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:31.987331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f404c-86d7-434d-bc52-754f74015407 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.049814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 177/343] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:32.051141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.051477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.051755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.060864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IJY7XKn9Rl6-JMz8nKbDvA, audit_chain_id=['IJY7XKn9Rl6-JMz8nKbDvA']) at 0x7fe8a14f4f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.061577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.061857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.062128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.062954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:32.063261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:32.064647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615052-c8c5-415b-8388-5dd5c0e3551c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:32.074667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:32.075846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:32.079627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 167/344] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:32.081326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9622ce9-b19c-4a20-89d2-e73edcb41796 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.081821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9622ce9-b19c-4a20-89d2-e73edcb41796 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.082370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9622ce9-b19c-4a20-89d2-e73edcb41796 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.084091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 168/345] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:32.089205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9622ce9-b19c-4a20-89d2-e73edcb41796 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.161313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 178/346] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:32.163080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.223840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9622ce9-b19c-4a20-89d2-e73edcb41796 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.264278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76e052-64ed-4164-9344-f5b64d8b5640 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HkVFKX6XR6qF1T7P72emLw, audit_chain_id=['HkVFKX6XR6qF1T7P72emLw']) at 0x7fe8a14e9ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.265114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e052-64ed-4164-9344-f5b64d8b5640 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.265394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e052-64ed-4164-9344-f5b64d8b5640 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.265666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76e052-64ed-4164-9344-f5b64d8b5640 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.267011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e052-64ed-4164-9344-f5b64d8b5640 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:32.268897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76e052-64ed-4164-9344-f5b64d8b5640 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:32.271279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 169/347] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:32.272841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.273156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.273431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.291193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b8c23-ad9b-4ed7-b601-d295bc2db42f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.295530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:32.296760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:32.331206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IJY7XKn9Rl6-JMz8nKbDvA, audit_chain_id=['IJY7XKn9Rl6-JMz8nKbDvA']) at 0x7fe8a14e2a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.332248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.332736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.333213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.380539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 170/348] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:32.386140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.425037 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:32.427120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:32.518417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16783902-11fe-4ba7-8586-9a100fc55ca6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.543814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 179/349] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:32.545033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.563937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cgk9OOvrSzGN-7gskA43Dg, audit_chain_id=['cgk9OOvrSzGN-7gskA43Dg']) at 0x7fe8a14dd220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.564955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.565278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.565552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.583090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:32.594149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:32.595148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:32.595945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 171/350] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:32.601687 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.679007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f6be6-ab02-488b-a5c9-5da819426525 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.722189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HkVFKX6XR6qF1T7P72emLw, audit_chain_id=['HkVFKX6XR6qF1T7P72emLw']) at 0x7fe8a14e5190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.723284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.723790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.724252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.732157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:32.733949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:32.734273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23306aa4-1139-4951-bdc2-d9f3d567991a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.736117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 180/351] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:32.737118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.774049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kjoZEm1mQdGLGfKvVjdKZw, audit_chain_id=['kjoZEm1mQdGLGfKvVjdKZw']) at 0x7fe8a14fb970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.774766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.775039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.775316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.788235 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:32.796342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:32.797383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:32.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 172/352] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:32.798790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.868794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d6ea9a-ad48-485c-9dba-225ee62cff9b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.904554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IJY7XKn9Rl6-JMz8nKbDvA, audit_chain_id=['IJY7XKn9Rl6-JMz8nKbDvA']) at 0x7fe8a14f3550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.905465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.905732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.906004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.907265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:32.908734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:32.910477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 181/353] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:32.911243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:32.916772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f47a7-3c7b-45b3-9274-c8517ef61881 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:32.956056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cgk9OOvrSzGN-7gskA43Dg, audit_chain_id=['cgk9OOvrSzGN-7gskA43Dg']) at 0x7fe8a14f10a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:32.956747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.957066 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.957343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.958115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:32.958419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:32.959860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635de882-c9ad-44f2-a3b8-e206b80c52c4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:32.981107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 173/354] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:32.981107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40c74-357b-45ac-abb5-31eb6c89f2d2 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:32.981107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40c74-357b-45ac-abb5-31eb6c89f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:32.981107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d40c74-357b-45ac-abb5-31eb6c89f2d2 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:32.981501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 174/355] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:32.983087 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40c74-357b-45ac-abb5-31eb6c89f2d2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.034792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d51ef-221e-4962-8f08-9e407057a858 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.069158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HkVFKX6XR6qF1T7P72emLw, audit_chain_id=['HkVFKX6XR6qF1T7P72emLw']) at 0x7fe8a14dc550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.070050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.070467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.070896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.071876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=6fb08088328845eabe2e402d4f9491df) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:33.072332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.074614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.080787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 182/356] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:33.081992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.108141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d40c74-357b-45ac-abb5-31eb6c89f2d2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.146719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kjoZEm1mQdGLGfKvVjdKZw, audit_chain_id=['kjoZEm1mQdGLGfKvVjdKZw']) at 0x7fe8a14d7070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.147613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.147969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.148319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.149213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:33.149598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.151130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.160812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 175/357] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:33.162106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.201920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73c746-36f4-4002-b51d-c7d8aa84c943 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.252548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f324fa78-6080-4af1-b476-a1e1fc5950a0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IJY7XKn9Rl6-JMz8nKbDvA, audit_chain_id=['IJY7XKn9Rl6-JMz8nKbDvA']) at 0x7fe8a14d3190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.253488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fa78-6080-4af1-b476-a1e1fc5950a0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.253830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fa78-6080-4af1-b476-a1e1fc5950a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.254109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f324fa78-6080-4af1-b476-a1e1fc5950a0 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.257315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324fa78-6080-4af1-b476-a1e1fc5950a0 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.258792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f324fa78-6080-4af1-b476-a1e1fc5950a0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.260933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 183/358] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:33.263061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da4493-3aa8-4a03-b08c-909121c6fa4d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.263445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da4493-3aa8-4a03-b08c-909121c6fa4d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.263816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da4493-3aa8-4a03-b08c-909121c6fa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.281813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-51da4493-3aa8-4a03-b08c-909121c6fa4d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:33.283017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-51da4493-3aa8-4a03-b08c-909121c6fa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:33.297711 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b4bfc-962b-42ed-ae5c-7ee64667d803 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.336510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b5167-a005-449b-bbfe-f32c39537a28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cgk9OOvrSzGN-7gskA43Dg, audit_chain_id=['cgk9OOvrSzGN-7gskA43Dg']) at 0x7fe8a14d7310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.337202 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b5167-a005-449b-bbfe-f32c39537a28 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.337486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b5167-a005-449b-bbfe-f32c39537a28 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.337957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b5167-a005-449b-bbfe-f32c39537a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.375861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 184/359] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:33.378349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75f409-575e-48b0-933c-b88a3e278aff None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.378636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75f409-575e-48b0-933c-b88a3e278aff None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.378906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75f409-575e-48b0-933c-b88a3e278aff None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.380285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 185/360] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:33.382379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75f409-575e-48b0-933c-b88a3e278aff None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.440161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b5167-a005-449b-bbfe-f32c39537a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.441689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9b5167-a005-449b-bbfe-f32c39537a28 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.506156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75f409-575e-48b0-933c-b88a3e278aff None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.543007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kjoZEm1mQdGLGfKvVjdKZw, audit_chain_id=['kjoZEm1mQdGLGfKvVjdKZw']) at 0x7fe8a14e1070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.543880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.544157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.544427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] PATH_INFO: `/v3/users/fea9f3812d5c4d629fe61edf8d1db6d0` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.545677 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] RBAC: Authorizing `identity:get_user(user_id=fea9f3812d5c4d629fe61edf8d1db6d0)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.547128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.548823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 186/361] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/users/fea9f3812d5c4d629fe61edf8d1db6d0 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:33.549551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.580113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 176/362] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:33.581934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.582220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.584608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.602182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:33.603361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:33.671145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203fc3ee-7b1f-487a-8d94-272dbba88ced None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.701319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 177/363] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:33.701901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.711696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=IJY7XKn9Rl6-JMz8nKbDvA, audit_chain_id=['IJY7XKn9Rl6-JMz8nKbDvA']) at 0x7fe8a1507c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.712635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.713119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.713559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.714614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=6fb08088328845eabe2e402d4f9491df) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:33.715118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.716714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.722475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 187/364] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:33.723546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.824360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1293d9f2-ee85-4ba9-9af2-c6be0d653eaf None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.868739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JBUlwRf0RhyYMxVaJIu2Yw, audit_chain_id=['JBUlwRf0RhyYMxVaJIu2Yw']) at 0x7fe8a1529bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.869552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721b54f2-e0a2-4cba-b436-57f9cc595966 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:33.869985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.869985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.870206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.882553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:33.891155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:33.892111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 178/365] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:33.893334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:33.908697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kjoZEm1mQdGLGfKvVjdKZw, audit_chain_id=['kjoZEm1mQdGLGfKvVjdKZw']) at 0x7fe8a1549eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:33.909407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:33.909764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:33.910066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:33.910976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] RBAC: Adding query filter params (role.id=7d0ab02adc9a4f9598ba0d9ea150b834, user.id=fea9f3812d5c4d629fe61edf8d1db6d0, scope.system=all) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:33.911289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:33.912833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:33.927342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 188/366] 10.222.0.49 () {56 vars in 1308 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/role_assignments?user.id=fea9f3812d5c4d629fe61edf8d1db6d0&scope.system=all&role.id=7d0ab02adc9a4f9598ba0d9ea150b834 => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:33.928230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.043697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab86584-c7bd-4837-9c9a-2daec7f8fbfc None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.048694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de53c7-1a99-4605-bd3b-31e50c5fb7c1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.087684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TPbclzEqRFm1zj51hV6_PA, audit_chain_id=['TPbclzEqRFm1zj51hV6_PA']) at 0x7fe8a14f01f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.088405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.088691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.088970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.101163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:34.107928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50774-beea-4322-9540-8975a754be5b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cgk9OOvrSzGN-7gskA43Dg, audit_chain_id=['cgk9OOvrSzGN-7gskA43Dg']) at 0x7fe8a14a70a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.108797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50774-beea-4322-9540-8975a754be5b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.109422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50774-beea-4322-9540-8975a754be5b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.109422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50774-beea-4322-9540-8975a754be5b None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:34.111475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:34.113819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 189/367] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:34.115700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.118491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50774-beea-4322-9540-8975a754be5b None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.118491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50774-beea-4322-9540-8975a754be5b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.118491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 179/368] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:33 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:34.123249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50774-beea-4322-9540-8975a754be5b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.223065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ccd7a1-41f6-4809-bddb-7f240b905379 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.257962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JBUlwRf0RhyYMxVaJIu2Yw, audit_chain_id=['JBUlwRf0RhyYMxVaJIu2Yw']) at 0x7fe8a14a3e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.258965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.259446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.259788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50774-beea-4322-9540-8975a754be5b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.260143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.262183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:34.262745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.264323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.273274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 190/369] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:34.274551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.296371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cgk9OOvrSzGN-7gskA43Dg, audit_chain_id=['cgk9OOvrSzGN-7gskA43Dg']) at 0x7fe8a1549850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.297263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.297544 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.298018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.299013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.300457 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.302427 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 180/370] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:34.303247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.382320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcc91c-f14c-43aa-abb2-44c33f18aabd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.408903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97dca7-b1d5-4adb-a032-169a12c396b4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.419126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TPbclzEqRFm1zj51hV6_PA, audit_chain_id=['TPbclzEqRFm1zj51hV6_PA']) at 0x7fe8a1505220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.420097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.420578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.421095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.422052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:34.422550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.424115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.433732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 191/371] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:34.435024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.447583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JBUlwRf0RhyYMxVaJIu2Yw, audit_chain_id=['JBUlwRf0RhyYMxVaJIu2Yw']) at 0x7fe8a153f0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.448242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.448581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.448849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.523214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.524691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.537074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a4350-d7da-487f-a061-c67445cbe78a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.572245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cgk9OOvrSzGN-7gskA43Dg, audit_chain_id=['cgk9OOvrSzGN-7gskA43Dg']) at 0x7fe8a14daf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.573180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.574174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.574757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.575812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:34.576355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.577964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.587565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 192/372] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:34.588443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.635858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 181/373] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:34.642712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:34.751616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91ae8a-0146-426f-a933-390cff83a290 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.815112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a48027-44bb-4d3f-baf2-e261a26a731c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:34.834313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TPbclzEqRFm1zj51hV6_PA, audit_chain_id=['TPbclzEqRFm1zj51hV6_PA']) at 0x7fe8a14fb100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.834986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.835265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.835535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.905720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JBUlwRf0RhyYMxVaJIu2Yw, audit_chain_id=['JBUlwRf0RhyYMxVaJIu2Yw']) at 0x7fe8a14d7790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:34.906977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:34.907471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:34.907948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:34.909452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.911295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.913530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 182/374] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:34.915179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:34.916667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:34.919214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:35.055345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 193/375] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:35.060333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed895cde-8aeb-4fd2-b085-6327dec3150a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:35.061957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:35.106888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JBUlwRf0RhyYMxVaJIu2Yw, audit_chain_id=['JBUlwRf0RhyYMxVaJIu2Yw']) at 0x7fe8a15244f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:35.107756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:35.108036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:35.108314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:35.110036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:35.111482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:35.113691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 183/376] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:34 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:35.125014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:35.223572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202174b4-901e-42c3-9772-8146973045a4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:35.232131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e414a3-7126-4bab-a2ec-2eb3b2b2ec92 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:35.267727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JBUlwRf0RhyYMxVaJIu2Yw, audit_chain_id=['JBUlwRf0RhyYMxVaJIu2Yw']) at 0x7fe8a14dab20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:35.268661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:35.269117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:35.269533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:35.270510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:35.270984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:35.272612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:35.276483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TPbclzEqRFm1zj51hV6_PA, audit_chain_id=['TPbclzEqRFm1zj51hV6_PA']) at 0x7fe8a14da1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:35.278470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:35.278754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:35.279032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] PATH_INFO: `/v3/projects/1a91e56fe3d748728a2efec64d71ac50` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:35.280348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 184/377] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:35 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:35.281826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] RBAC: Authorizing `identity:get_project(project_id=1a91e56fe3d748728a2efec64d71ac50)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:35.283549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:35.285984 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 194/378] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:35 2022] GET /identity/v3/projects/1a91e56fe3d748728a2efec64d71ac50 => generated 344 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:35.291467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:35.402257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f018513-92cf-4fb9-b8df-7d06eeb30976 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:35.440283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe1728-32ea-46f9-abf7-befdf1930dfb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TPbclzEqRFm1zj51hV6_PA, audit_chain_id=['TPbclzEqRFm1zj51hV6_PA']) at 0x7fe8a15249d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:35.441425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1728-32ea-46f9-abf7-befdf1930dfb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:35.441852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1728-32ea-46f9-abf7-befdf1930dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:35.442292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe1728-32ea-46f9-abf7-befdf1930dfb None admin] PATH_INFO: `/v3/groups/5cee7b76c2304081b5b4fc7ede3c7942` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:35.449464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1728-32ea-46f9-abf7-befdf1930dfb None admin] RBAC: Authorizing `identity:get_group(group_id=5cee7b76c2304081b5b4fc7ede3c7942)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:35.451186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fe1728-32ea-46f9-abf7-befdf1930dfb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:35.453585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 185/379] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:35 2022] GET /identity/v3/groups/5cee7b76c2304081b5b4fc7ede3c7942 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:35.459384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:35.589916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7670c29-a176-4c8c-b63d-555b6a6fedb5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:35.636331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=TPbclzEqRFm1zj51hV6_PA, audit_chain_id=['TPbclzEqRFm1zj51hV6_PA']) at 0x7fe8a14e5190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:35.637265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:35.637688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:35.638103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:35.639097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] RBAC: Adding query filter params (group.id=5cee7b76c2304081b5b4fc7ede3c7942, role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=1a91e56fe3d748728a2efec64d71ac50) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:35.639548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:35.641146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90a7f12-8471-4f2e-aa5e-f2cf78d9a4f5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:35.654230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 195/380] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:35 2022] GET /identity/v3/role_assignments?group.id=5cee7b76c2304081b5b4fc7ede3c7942&scope.project.id=1a91e56fe3d748728a2efec64d71ac50&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:36.046590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e33d-4259-40e6-9330-da9f4ab9a1db None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.047100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e33d-4259-40e6-9330-da9f4ab9a1db None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.047513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c8e33d-4259-40e6-9330-da9f4ab9a1db None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.049269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 186/381] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:36.055976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.056880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.057377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.079210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:36.080729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:36.163411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 196/382] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:36.196502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8e33d-4259-40e6-9330-da9f4ab9a1db None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:36.313817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c8e33d-4259-40e6-9330-da9f4ab9a1db None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:36.360182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lm1bYavcRZ6S4hnqwrgKWw, audit_chain_id=['lm1bYavcRZ6S4hnqwrgKWw']) at 0x7fe8a153fc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:36.361018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.361304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.361580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.372776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:36.381083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:36.381947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:36.382716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 187/383] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:36.389924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:36.517174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed54f793-22ef-4b2f-a968-f1a6ee273bc7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:36.557143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lm1bYavcRZ6S4hnqwrgKWw, audit_chain_id=['lm1bYavcRZ6S4hnqwrgKWw']) at 0x7fe8a15230d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:36.558880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.559355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.559844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.560778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:36.561309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:36.562868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:36.574300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 197/384] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:36.580502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:36.731163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f37f9-5e8f-4ab8-888f-f12f5171e6cf None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:36.771427 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ecdf61-f4cb-4636-a0fd-9a7a7b4b95d9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lm1bYavcRZ6S4hnqwrgKWw, audit_chain_id=['lm1bYavcRZ6S4hnqwrgKWw']) at 0x7fe8a14b4c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:36.772816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecdf61-f4cb-4636-a0fd-9a7a7b4b95d9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.773023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecdf61-f4cb-4636-a0fd-9a7a7b4b95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.773370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecdf61-f4cb-4636-a0fd-9a7a7b4b95d9 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.774479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecdf61-f4cb-4636-a0fd-9a7a7b4b95d9 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:36.775938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ecdf61-f4cb-4636-a0fd-9a7a7b4b95d9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:36.777948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 188/385] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:36 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:36.783301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:36.805630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c07175-5791-496e-b9e0-ae3fbabd2c75 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.805935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c07175-5791-496e-b9e0-ae3fbabd2c75 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.806452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c07175-5791-496e-b9e0-ae3fbabd2c75 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.809655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 189/386] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:36.815321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.815897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.816552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.856903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:36.858484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:36.939961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5e0404-599a-47b6-9cec-3bdf82335f44 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:36.985008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 190/387] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:36.985185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lm1bYavcRZ6S4hnqwrgKWw, audit_chain_id=['lm1bYavcRZ6S4hnqwrgKWw']) at 0x7fe8a14f0670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:36.985185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:36.985185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:36.985185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:36.985467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:36.985662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:36.987943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 198/388] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:36 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:36.993607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:37.032660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:37.145391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324354d5-e49b-4c7c-a364-1c9cba9085d3 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:37.187160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lm1bYavcRZ6S4hnqwrgKWw, audit_chain_id=['lm1bYavcRZ6S4hnqwrgKWw']) at 0x7fe8a14b47c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:37.188318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:37.188748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:37.189350 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df/groups/403d649702054eb58dbc87ea997f4005/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:37.191908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb08088328845eabe2e402d4f9491df, group_id=403d649702054eb58dbc87ea997f4005, role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:37.193520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:37.210013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 191/389] 10.222.0.49 () {58 vars in 1442 bytes} [Fri May 13 12:40:36 2022] PUT /identity/v3/projects/6fb08088328845eabe2e402d4f9491df/groups/403d649702054eb58dbc87ea997f4005/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:40:37.306711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6029075-3ae4-4641-8634-0cf5f0dc853b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:37.363552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97517f55-6163-4000-8f6e-809ebd296adf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHEa1tLGT7ywsBi0kKO2Xg, audit_chain_id=['FHEa1tLGT7ywsBi0kKO2Xg']) at 0x7fe8a14e5a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:37.364384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97517f55-6163-4000-8f6e-809ebd296adf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:37.364670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97517f55-6163-4000-8f6e-809ebd296adf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:37.364947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97517f55-6163-4000-8f6e-809ebd296adf None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:37.380904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97517f55-6163-4000-8f6e-809ebd296adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-97517f55-6163-4000-8f6e-809ebd296adf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:37.390279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:37.391193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:37.391998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 199/390] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:37.397816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:37.556338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a436a7e-b5e3-4a9a-8365-c419a90190c2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:37.559979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ca3a-a970-4016-94fc-698b96f5d41f None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:37.560586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ca3a-a970-4016-94fc-698b96f5d41f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:37.564086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9ca3a-a970-4016-94fc-698b96f5d41f None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:37.564086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 200/391] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:37.574176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:37.574530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:37.575044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:37.598741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:37.599940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:37.615638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHEa1tLGT7ywsBi0kKO2Xg, audit_chain_id=['FHEa1tLGT7ywsBi0kKO2Xg']) at 0x7fe8a153f1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:37.616311 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:37.616589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:37.616863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:37.617651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:37.617949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:37.619497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:37.631159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 192/392] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:37.638109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:37.692804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 201/393] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:37.717474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:37.789905 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1eae1-ec18-4db1-b802-8f432dc92ff6 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:37.857206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHEa1tLGT7ywsBi0kKO2Xg, audit_chain_id=['FHEa1tLGT7ywsBi0kKO2Xg']) at 0x7fe8a1528ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:37.858483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:37.858958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:37.859417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:37.861996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:37.863651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:37.865532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 193/394] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:37 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:37.874573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:37.922836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151cc6f-e170-4ebe-9e04-450adf2c4239 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.041667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c31e05-1d71-4ef9-9056-c727df110b7a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.044518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K_FjH1h5QFSF0QRWcfG4Zg, audit_chain_id=['K_FjH1h5QFSF0QRWcfG4Zg']) at 0x7fe8a14f0f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.045664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.046162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.046653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.074006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:38.083010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:38.083993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:38.084781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:38.087261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 202/395] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:38.091739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHEa1tLGT7ywsBi0kKO2Xg, audit_chain_id=['FHEa1tLGT7ywsBi0kKO2Xg']) at 0x7fe8a153f880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.093186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.093681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.094216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.095369 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.100926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:38.108294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:38.110897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 194/396] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:37 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:38.116628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.277892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1a4c0b-94a0-4b8d-bee8-6e181c36fcdc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.299495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca539a1a-80f8-4c97-8fab-77022184c400 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.337485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FHEa1tLGT7ywsBi0kKO2Xg, audit_chain_id=['FHEa1tLGT7ywsBi0kKO2Xg']) at 0x7fe8a14ee250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.338858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.339552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.340054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df/groups/403d649702054eb58dbc87ea997f4005/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.342753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] RBAC: Authorizing `identity:create_grant(project_id=6fb08088328845eabe2e402d4f9491df, group_id=403d649702054eb58dbc87ea997f4005, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:38.344456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:38.364399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 195/397] 10.222.0.49 () {58 vars in 1442 bytes} [Fri May 13 12:40:38 2022] PUT /identity/v3/projects/6fb08088328845eabe2e402d4f9491df/groups/403d649702054eb58dbc87ea997f4005/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:40:38.368122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K_FjH1h5QFSF0QRWcfG4Zg, audit_chain_id=['K_FjH1h5QFSF0QRWcfG4Zg']) at 0x7fe8a1461730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.369592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.370083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.371367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.372595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:38.373218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:38.374915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7964c5f2-637f-4cfe-a0c9-745e0968fadd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:38.384828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 203/398] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:38.397332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.520574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e8983-5a98-49a9-a43b-fc290b99b241 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.522522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c48e7-5ed0-4115-981f-8752cf1f6e8d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.522816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c48e7-5ed0-4115-981f-8752cf1f6e8d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.523098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8c48e7-5ed0-4115-981f-8752cf1f6e8d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.524802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 204/399] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:38.531976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.532241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.532432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.559823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K_FjH1h5QFSF0QRWcfG4Zg, audit_chain_id=['K_FjH1h5QFSF0QRWcfG4Zg']) at 0x7fe8a1f5fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.560694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.560977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.561278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.562502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:38.563968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:38.565957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 196/400] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:38 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:38.576288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:38.576466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.577640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:38.657128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 205/401] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:38.676291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.705594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e7df-765a-4d8f-92bd-991a06e88a53 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.750704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K_FjH1h5QFSF0QRWcfG4Zg, audit_chain_id=['K_FjH1h5QFSF0QRWcfG4Zg']) at 0x7fe8a1531730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.751575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.751859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.752131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.753998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:38.761973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:38.763749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 197/402] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:38 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:38.773345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.808831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd8e4b-9cda-48ce-9d4c-bf43cb4f0155 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:38.876574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5JFj1D_MRUeKV-7oQ8eAqQ, audit_chain_id=['5JFj1D_MRUeKV-7oQ8eAqQ']) at 0x7fe8a1822cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:38.877413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:38.877695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:38.877975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:38.896863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:38.911641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:38.913922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:38.915831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 206/403] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:38.923600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:38.985310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f1455-0727-4fee-81cd-6e3ecb997c0c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.060686 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079ad0d9-985d-467b-a2a3-13dcc3f325b5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=K_FjH1h5QFSF0QRWcfG4Zg, audit_chain_id=['K_FjH1h5QFSF0QRWcfG4Zg']) at 0x7fe8a151c2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.061519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad0d9-985d-467b-a2a3-13dcc3f325b5 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.061801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad0d9-985d-467b-a2a3-13dcc3f325b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.062074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079ad0d9-985d-467b-a2a3-13dcc3f325b5 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/groups/403d649702054eb58dbc87ea997f4005/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.065831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad0d9-985d-467b-a2a3-13dcc3f325b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c, group_id=403d649702054eb58dbc87ea997f4005, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:39.067283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079ad0d9-985d-467b-a2a3-13dcc3f325b5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:39.092914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 198/404] 10.222.0.49 () {58 vars in 1442 bytes} [Fri May 13 12:40:38 2022] PUT /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/groups/403d649702054eb58dbc87ea997f4005/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:39.111615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147bf84-6de8-43fd-aa25-41832d903392 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.147117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee3202-d4e5-4186-992d-0861ebab282a None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.147426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee3202-d4e5-4186-992d-0861ebab282a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.147684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee3202-d4e5-4186-992d-0861ebab282a None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.149084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 199/405] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:40:39.155277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.155706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.155993 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.165778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5JFj1D_MRUeKV-7oQ8eAqQ, audit_chain_id=['5JFj1D_MRUeKV-7oQ8eAqQ']) at 0x7fe8a14a3ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.166472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.166757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.167035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.168246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:39.168677 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:39.170167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:39.174163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:39.175384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:39.187889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 207/406] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:39.193548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:39.252248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 200/407] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:39.279291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:39.375217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3cd21-dc5e-4ee6-ac38-20c2aa88be51 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.423350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5JFj1D_MRUeKV-7oQ8eAqQ, audit_chain_id=['5JFj1D_MRUeKV-7oQ8eAqQ']) at 0x7fe8a14e2430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.424216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.424511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.426419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.428373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:39.429882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:39.431797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 208/408] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:39 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:39.438002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:39.451461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3896fac-e32a-4a5f-af44-64f3e0dffc2b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.491542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Reg_oHulSKqjwHil8ZZSQA, audit_chain_id=['Reg_oHulSKqjwHil8ZZSQA']) at 0x7fe8a14da640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.492714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.493229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.493691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.505558 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:39.514322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:39.515213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:39.516024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:39.518635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 201/409] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:39.525187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:39.586625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afd953-a93b-42f5-92b4-eaeb51b5e87a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.648171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5JFj1D_MRUeKV-7oQ8eAqQ, audit_chain_id=['5JFj1D_MRUeKV-7oQ8eAqQ']) at 0x7fe8a1507670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.649053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.649328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.649596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.656034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:39.657522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:39.659439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 209/410] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:39 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:39.668851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:39.702991 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f106fd-1295-4457-bec4-0c8f9d218311 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.744559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Reg_oHulSKqjwHil8ZZSQA, audit_chain_id=['Reg_oHulSKqjwHil8ZZSQA']) at 0x7fe8a14b1e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.745892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.746184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.746457 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.747406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:39.747710 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:39.749852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:39.760250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 202/411] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:39.768404 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:39.879765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cee8ed-2832-4e83-bc8f-ae204829e9a9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.911218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02198-8df5-48d8-bb02-68041cdc661c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:39.917725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Reg_oHulSKqjwHil8ZZSQA, audit_chain_id=['Reg_oHulSKqjwHil8ZZSQA']) at 0x7fe8a14e39a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:39.919475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:39.919755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:39.920027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] PATH_INFO: `/v3/groups/5cee7b76c2304081b5b4fc7ede3c7942` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:39.921261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] RBAC: Authorizing `identity:get_group(group_id=5cee7b76c2304081b5b4fc7ede3c7942)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:39.922699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:39.925113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 203/412] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:39 2022] GET /identity/v3/groups/5cee7b76c2304081b5b4fc7ede3c7942 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:39.931014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:40.017710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5JFj1D_MRUeKV-7oQ8eAqQ, audit_chain_id=['5JFj1D_MRUeKV-7oQ8eAqQ']) at 0x7fe8a14dafd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:40.018612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.018897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.019178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/groups/403d649702054eb58dbc87ea997f4005/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.026444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c, group_id=403d649702054eb58dbc87ea997f4005, role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:40.029296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:40.055214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d22e16-0b5f-4928-8dff-7899888147ff None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:40.064320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 210/413] 10.222.0.49 () {58 vars in 1442 bytes} [Fri May 13 12:40:39 2022] PUT /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c/groups/403d649702054eb58dbc87ea997f4005/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:40:40.091600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771aac08-daf2-458c-8566-d93f56c7d0ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Reg_oHulSKqjwHil8ZZSQA, audit_chain_id=['Reg_oHulSKqjwHil8ZZSQA']) at 0x7fe8a14d16a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:40.092513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aac08-daf2-458c-8566-d93f56c7d0ba None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.092792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aac08-daf2-458c-8566-d93f56c7d0ba None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.093082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771aac08-daf2-458c-8566-d93f56c7d0ba None admin] PATH_INFO: `/v3/projects/1a91e56fe3d748728a2efec64d71ac50` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.094409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aac08-daf2-458c-8566-d93f56c7d0ba None admin] RBAC: Authorizing `identity:get_project(project_id=1a91e56fe3d748728a2efec64d71ac50)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:40.096014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771aac08-daf2-458c-8566-d93f56c7d0ba None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:40.097857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 204/414] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:39 2022] GET /identity/v3/projects/1a91e56fe3d748728a2efec64d71ac50 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:40.106878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:40.247509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086111-afe7-443c-a2bb-8c7daadddbaf None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.247688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086111-afe7-443c-a2bb-8c7daadddbaf None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.247964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086111-afe7-443c-a2bb-8c7daadddbaf None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.253029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 205/415] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:40.261065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.261065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.261065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.273011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a718b4-b78a-4848-8ab2-4ecbefc071f5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:40.300370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:40.307577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:40.341016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Reg_oHulSKqjwHil8ZZSQA, audit_chain_id=['Reg_oHulSKqjwHil8ZZSQA']) at 0x7fe8a14f7640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:40.341016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.341016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.341356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] PATH_INFO: `/v3/projects/1a91e56fe3d748728a2efec64d71ac50/groups/5cee7b76c2304081b5b4fc7ede3c7942/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.349006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a91e56fe3d748728a2efec64d71ac50, group_id=5cee7b76c2304081b5b4fc7ede3c7942, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:40.349006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:40.380193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 211/416] 10.222.0.49 () {58 vars in 1442 bytes} [Fri May 13 12:40:40 2022] PUT /identity/v3/projects/1a91e56fe3d748728a2efec64d71ac50/groups/5cee7b76c2304081b5b4fc7ede3c7942/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:40:40.444222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 206/417] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:40.517445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:40.648645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dda997-012b-4e22-b9f6-ff6506d1cb73 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:40.691424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=voFCiwtbToqjIjWnsf0wyA, audit_chain_id=['voFCiwtbToqjIjWnsf0wyA']) at 0x7fe8a15074f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:40.692233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.692517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.692791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.706049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:40.714319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:40.715425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:40.716362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:40.718049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 212/418] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:40.722546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:40.831466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217893e-ccf3-4cb9-83a4-e5b7f9836a4f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:40.867714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=voFCiwtbToqjIjWnsf0wyA, audit_chain_id=['voFCiwtbToqjIjWnsf0wyA']) at 0x7fe8a14da550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:40.868461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:40.868743 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:40.869060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:40.869839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:40.870151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:40.872937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314a0bd-6c6c-4bb8-b194-5210281af7a1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:40.883079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 207/419] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:40.890434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.003816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0f099-c204-4003-85ee-51ea8c6b3758 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:41.041839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=voFCiwtbToqjIjWnsf0wyA, audit_chain_id=['voFCiwtbToqjIjWnsf0wyA']) at 0x7fe8a14570d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:41.043164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.043566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.043784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.084908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697138e-be53-4f70-ac15-f65ca7ffab6e None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.085234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697138e-be53-4f70-ac15-f65ca7ffab6e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.085386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697138e-be53-4f70-ac15-f65ca7ffab6e None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.086752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 208/420] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:41.092285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.092568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.092846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.122921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:41.124120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:41.159233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:41.160730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:41.270706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 209/421] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:41.295315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 213/422] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:41.300942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.306565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.447227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33542432-ebc8-4cd6-a598-89c399f66a13 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:41.496323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=voFCiwtbToqjIjWnsf0wyA, audit_chain_id=['voFCiwtbToqjIjWnsf0wyA']) at 0x7fe8a14ee250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:41.499099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.499590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.500080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.501921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:41.503576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:41.507117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3e397-0391-433f-a68e-adea39140aa1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:41.507727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 210/423] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:41 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:41.515643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.587919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VyQGlhYYQLGxpVYz0bNAlg, audit_chain_id=['VyQGlhYYQLGxpVYz0bNAlg']) at 0x7fe8a1501400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:41.588711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.589559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.589840 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.606940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:41.614694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:41.615663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:41.617368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 214/424] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:41.626025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.720681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fac3e28-d894-490d-9cf9-3b951534b757 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:41.791486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455bb5-9678-4949-afa7-444600494920 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=voFCiwtbToqjIjWnsf0wyA, audit_chain_id=['voFCiwtbToqjIjWnsf0wyA']) at 0x7fe8a14e02e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:41.793101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455bb5-9678-4949-afa7-444600494920 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.793577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455bb5-9678-4949-afa7-444600494920 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.793924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455bb5-9678-4949-afa7-444600494920 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.796374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03455bb5-9678-4949-afa7-444600494920 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:41.797839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03455bb5-9678-4949-afa7-444600494920 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:41.799685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 211/425] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:41 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:41.809367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455bb5-9678-4949-afa7-444600494920 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.834178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fbc4d-82ec-441d-bdd5-36ed7280e4f7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:41.882538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VyQGlhYYQLGxpVYz0bNAlg, audit_chain_id=['VyQGlhYYQLGxpVYz0bNAlg']) at 0x7fe8a14a37c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:41.883583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:41.884060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:41.884550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:41.885855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:41.891346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:41.894625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:41.907694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 215/426] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:41.914123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:41.992633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455bb5-9678-4949-afa7-444600494920 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.039845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=voFCiwtbToqjIjWnsf0wyA, audit_chain_id=['voFCiwtbToqjIjWnsf0wyA']) at 0x7fe8a1531f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.040646 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.041260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.041536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.042666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=6fb08088328845eabe2e402d4f9491df) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:42.042976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.043992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428cd59b-5eca-4869-99ba-6ff55a31f14c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.044420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a0344e-3ded-4087-ab67-6d4f54d204f2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.052286 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 212/427] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:41 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:42.058825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3a7e8-f711-4654-ac22-051f188d1ce8 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.059326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3a7e8-f711-4654-ac22-051f188d1ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.059795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b3a7e8-f711-4654-ac22-051f188d1ce8 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.063580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 213/428] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:42.075213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.075536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.075772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.101885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VyQGlhYYQLGxpVYz0bNAlg, audit_chain_id=['VyQGlhYYQLGxpVYz0bNAlg']) at 0x7fe8a14f0f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.102975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.103516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.104004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.109254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:42.111690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:42.236235 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.238179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.260867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 214/429] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:42.285299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:42.402546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 216/430] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:42.410279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:42.419886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ad17-4db1-460e-a4f6-cf18db4e1283 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.457214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OZVyFP7EQDKSTW6Hmm36bA, audit_chain_id=['OZVyFP7EQDKSTW6Hmm36bA']) at 0x7fe8a14d7af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.458074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.458366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.458815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.471549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:42.479394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:42.480450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 13 12:40:42.481720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:42.483099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 215/431] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:42.489325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:42.568077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caef2e-cf6b-4185-827d-6e428c876bf0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.613184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VyQGlhYYQLGxpVYz0bNAlg, audit_chain_id=['VyQGlhYYQLGxpVYz0bNAlg']) at 0x7fe8a14fa4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.614374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.614799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.615202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] PATH_INFO: `/v3/projects/6fb08088328845eabe2e402d4f9491df` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.616574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] RBAC: Authorizing `identity:get_project(project_id=6fb08088328845eabe2e402d4f9491df)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.618679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.622564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 217/432] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:42 2022] GET /identity/v3/projects/6fb08088328845eabe2e402d4f9491df => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:42.623962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ac4210-5ff5-4932-9d27-e6460baa16bd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.633164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:42.661016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OZVyFP7EQDKSTW6Hmm36bA, audit_chain_id=['OZVyFP7EQDKSTW6Hmm36bA']) at 0x7fe8a1491220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.661687 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.661969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.662244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.662989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] RBAC: Adding query filter params (name=member) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:42.663295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.664670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.674017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 216/433] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:40:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:42.681952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:42.738957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd3370-52b4-465e-bf87-f3bc8c844d23 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.778572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VyQGlhYYQLGxpVYz0bNAlg, audit_chain_id=['VyQGlhYYQLGxpVYz0bNAlg']) at 0x7fe8a1507490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.779113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.779389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.779664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.780877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.782423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.784298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 218/434] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:42 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:42.789952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:42.798635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b869afc-bf1d-4011-86b2-9aa928900ea1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.838324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bdce6e-105e-4221-a5bf-79b59ea08802 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OZVyFP7EQDKSTW6Hmm36bA, audit_chain_id=['OZVyFP7EQDKSTW6Hmm36bA']) at 0x7fe8a14cb2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.839085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdce6e-105e-4221-a5bf-79b59ea08802 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.839330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdce6e-105e-4221-a5bf-79b59ea08802 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.839597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bdce6e-105e-4221-a5bf-79b59ea08802 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.916623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae33b1-b66d-42b5-87b4-37e62cc22afa None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:42.927257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdce6e-105e-4221-a5bf-79b59ea08802 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.928767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bdce6e-105e-4221-a5bf-79b59ea08802 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.961838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VyQGlhYYQLGxpVYz0bNAlg, audit_chain_id=['VyQGlhYYQLGxpVYz0bNAlg']) at 0x7fe8a14ee760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:42.963111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:42.963743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:42.965526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:42.966885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=6fb08088328845eabe2e402d4f9491df) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:42.967418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:42.973279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:42.983470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 219/435] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:42 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=6fb08088328845eabe2e402d4f9491df&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 611 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:43.051949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 217/436] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:43.057254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.080055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3e03-b050-4aef-8fe5-f5863b7a2fbe None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.080258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3e03-b050-4aef-8fe5-f5863b7a2fbe None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.080452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e3e03-b050-4aef-8fe5-f5863b7a2fbe None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.083803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 218/437] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:43.087833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.088117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.088647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.109503 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:43.111357 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:43.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3f96f-d397-4322-afef-099385c71dcc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.190780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 219/438] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:43.213628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.229010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OZVyFP7EQDKSTW6Hmm36bA, audit_chain_id=['OZVyFP7EQDKSTW6Hmm36bA']) at 0x7fe8a1507490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.230738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.231243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.231663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.233135 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:43.234706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:43.236953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 220/439] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:43.241956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.341620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4c7af3-045c-4f84-bc62-18cd019c85c3 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.368921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c895343-6508-4fce-81b9-e64b39113be1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.388212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc262c-fc93-47b6-904c-c7e0ae386032 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UfkIlmkDQ8uvXPC_x4ZTfQ, audit_chain_id=['UfkIlmkDQ8uvXPC_x4ZTfQ']) at 0x7fe8a14d1b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.389108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc262c-fc93-47b6-904c-c7e0ae386032 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.389385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc262c-fc93-47b6-904c-c7e0ae386032 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.389670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc262c-fc93-47b6-904c-c7e0ae386032 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.402640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc262c-fc93-47b6-904c-c7e0ae386032 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a7cc262c-fc93-47b6-904c-c7e0ae386032 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:43.410547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:43.411538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:43.412314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:43.412921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OZVyFP7EQDKSTW6Hmm36bA, audit_chain_id=['OZVyFP7EQDKSTW6Hmm36bA']) at 0x7fe8a149eca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.412921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.413096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 220/440] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:43.413160 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.414757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c057-27b2-4fd5-9918-2d1d0d794673 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.414876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.414948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c057-27b2-4fd5-9918-2d1d0d794673 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.414948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6c057-27b2-4fd5-9918-2d1d0d794673 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.415063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:43.418955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 221/441] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:43.419113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:43.419192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c057-27b2-4fd5-9918-2d1d0d794673 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.419260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 221/442] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:43.424328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.567014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6c057-27b2-4fd5-9918-2d1d0d794673 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.582103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020d34c-fad3-40fe-ac91-4663bf37f84e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.608789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UfkIlmkDQ8uvXPC_x4ZTfQ, audit_chain_id=['UfkIlmkDQ8uvXPC_x4ZTfQ']) at 0x7fe8a14cb550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.609526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.609811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.610088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.610847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:43.611337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:43.613015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c590bf-17ed-4270-99b0-3678c70e89ba None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:43.624156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 222/443] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:43.624337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OZVyFP7EQDKSTW6Hmm36bA, audit_chain_id=['OZVyFP7EQDKSTW6Hmm36bA']) at 0x7fe8a14fac40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.624455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.624528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.624777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.624899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.624972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.625079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.626360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=fa930edb07634faa8c2c98410f8403d6, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:43.627003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:43.629668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:43.637434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 222/444] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=fa930edb07634faa8c2c98410f8403d6 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:43.638309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.647315 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:43.648563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:43.742522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 223/445] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:43.766681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:43.769563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184c006-a660-43c8-8941-7347ccf76735 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.817879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UfkIlmkDQ8uvXPC_x4ZTfQ, audit_chain_id=['UfkIlmkDQ8uvXPC_x4ZTfQ']) at 0x7fe8a14ffb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.818551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.818831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.819111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.885151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59872c1-f679-4842-ab84-fdb27bb67dd5 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:43.909662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:43.911134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:43.925895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n4xWQ87TT4iV1xkqqo9SFw, audit_chain_id=['n4xWQ87TT4iV1xkqqo9SFw']) at 0x7fe8a14d16a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:43.928848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:43.929444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:43.929905 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:43.943964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:43.952026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:43.953153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:43.955893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 224/446] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:43.959092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.051408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 223/447] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:44.057060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.095155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c501f-5035-4ebd-a7c8-503bcd229036 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.129376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n4xWQ87TT4iV1xkqqo9SFw, audit_chain_id=['n4xWQ87TT4iV1xkqqo9SFw']) at 0x7fe8a14ea5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.130171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.130521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.130865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.131703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:44.132078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.133560 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.142649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 225/448] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:44.150349 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.178729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0a379-85bd-4c43-96d2-d9366469df24 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.216908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UfkIlmkDQ8uvXPC_x4ZTfQ, audit_chain_id=['UfkIlmkDQ8uvXPC_x4ZTfQ']) at 0x7fe8a15230d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.217791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.218076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.218348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] PATH_INFO: `/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.219598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] RBAC: Authorizing `identity:get_project(project_id=4da3ddd1356f4f2f98ea2b94dbd24a9c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.221054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.222926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 224/449] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/projects/4da3ddd1356f4f2f98ea2b94dbd24a9c => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:44.228177 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.261491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013fff8-137b-49e3-816f-b2cc6c031976 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.295697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n4xWQ87TT4iV1xkqqo9SFw, audit_chain_id=['n4xWQ87TT4iV1xkqqo9SFw']) at 0x7fe8a14dd460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.296347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.296629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.296906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.327765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01906f3-eced-4b61-b8c3-bd2ac80605b8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.364482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UfkIlmkDQ8uvXPC_x4ZTfQ, audit_chain_id=['UfkIlmkDQ8uvXPC_x4ZTfQ']) at 0x7fe8a14f0820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.365598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.365882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.366158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] PATH_INFO: `/v3/groups/403d649702054eb58dbc87ea997f4005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.367383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] RBAC: Authorizing `identity:get_group(group_id=403d649702054eb58dbc87ea997f4005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.368810 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.371459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 225/450] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/groups/403d649702054eb58dbc87ea997f4005 => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:44.373493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.375030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.377068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.477330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 226/451] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 12:40:44.477812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a0123e-bfdb-4246-b5e6-8cfdc5faf482 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.483927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.513596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UfkIlmkDQ8uvXPC_x4ZTfQ, audit_chain_id=['UfkIlmkDQ8uvXPC_x4ZTfQ']) at 0x7fe8a14d3970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.514251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.514530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.514798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.515629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] RBAC: Adding query filter params (group.id=403d649702054eb58dbc87ea997f4005, role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:44.515935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.517416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.523510 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 226/452] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/role_assignments?group.id=403d649702054eb58dbc87ea997f4005&scope.project.id=4da3ddd1356f4f2f98ea2b94dbd24a9c&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:44.598407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f22024-7165-4512-9ea4-22a068916769 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.637125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n4xWQ87TT4iV1xkqqo9SFw, audit_chain_id=['n4xWQ87TT4iV1xkqqo9SFw']) at 0x7fe8a14ee2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.638024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.638270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.638546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] PATH_INFO: `/v3/projects/1a91e56fe3d748728a2efec64d71ac50` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.639832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] RBAC: Authorizing `identity:get_project(project_id=1a91e56fe3d748728a2efec64d71ac50)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.641326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.643074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 227/453] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/projects/1a91e56fe3d748728a2efec64d71ac50 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:44.650240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.764212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425839d2-d781-4033-a737-9980c0a524c2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.799707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f4943-6c66-471f-8366-cb0b34c0f3d8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n4xWQ87TT4iV1xkqqo9SFw, audit_chain_id=['n4xWQ87TT4iV1xkqqo9SFw']) at 0x7fe8a14e1070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.800560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4943-6c66-471f-8366-cb0b34c0f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.800866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4943-6c66-471f-8366-cb0b34c0f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.801197 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f4943-6c66-471f-8366-cb0b34c0f3d8 None admin] PATH_INFO: `/v3/groups/5cee7b76c2304081b5b4fc7ede3c7942` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.802356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f4943-6c66-471f-8366-cb0b34c0f3d8 None admin] RBAC: Authorizing `identity:get_group(group_id=5cee7b76c2304081b5b4fc7ede3c7942)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.803781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0f4943-6c66-471f-8366-cb0b34c0f3d8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.805454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 227/454] 10.222.0.49 () {56 vars in 1180 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/groups/5cee7b76c2304081b5b4fc7ede3c7942 => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:44.811634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:44.932765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582bb8b-6a0e-4da5-98e9-f2b311fdac02 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:44.972355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n4xWQ87TT4iV1xkqqo9SFw, audit_chain_id=['n4xWQ87TT4iV1xkqqo9SFw']) at 0x7fe8a14e40a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:44.973340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:44.973760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:44.974163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:44.975464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] RBAC: Adding query filter params (group.id=5cee7b76c2304081b5b4fc7ede3c7942, role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=1a91e56fe3d748728a2efec64d71ac50) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:44.975933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:44.978145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b109c-5cfc-4f01-8d7e-925f96d9fac0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:44.985158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 228/455] 10.222.0.49 () {56 vars in 1376 bytes} [Fri May 13 12:40:44 2022] GET /identity/v3/role_assignments?group.id=5cee7b76c2304081b5b4fc7ede3c7942&scope.project.id=1a91e56fe3d748728a2efec64d71ac50&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:47.639897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c63a-934b-4dc2-939b-40a368ae9420 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:47.640448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c63a-934b-4dc2-939b-40a368ae9420 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:47.640448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5c63a-934b-4dc2-939b-40a368ae9420 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:47.642094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 228/456] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:47.647050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b2abb-180a-4b3a-8e99-ae6a5f7cef7d None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:47.647471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b2abb-180a-4b3a-8e99-ae6a5f7cef7d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:47.647658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b2abb-180a-4b3a-8e99-ae6a5f7cef7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:47.669985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-165b2abb-180a-4b3a-8e99-ae6a5f7cef7d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:47.671249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-165b2abb-180a-4b3a-8e99-ae6a5f7cef7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:47.754439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 229/457] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:47.797958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5c63a-934b-4dc2-939b-40a368ae9420 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:47.956402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5c63a-934b-4dc2-939b-40a368ae9420 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.005559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gEJBaHvtRQqXA71CDwyHJw, audit_chain_id=['gEJBaHvtRQqXA71CDwyHJw']) at 0x7fe8a1507130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.006427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.006709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.006980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.026084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.028121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.034119 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d8440-3305-4685-a0ad-132787f1bbb4 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.034402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d8440-3305-4685-a0ad-132787f1bbb4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.034687 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7d8440-3305-4685-a0ad-132787f1bbb4 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.038253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 230/458] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:40:48.043931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.044478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.044955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:48.052083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:48.053209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:48.054072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:48.054072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:48.054072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:48.054072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:48.054072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 229/459] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:48.058959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.083281 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:48.084456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:48.216591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 231/460] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:48.236450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c730c-04c0-4f3a-ba50-a913ab3c8d7e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.253717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.272393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gEJBaHvtRQqXA71CDwyHJw, audit_chain_id=['gEJBaHvtRQqXA71CDwyHJw']) at 0x7fe8a1468160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.273103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.273385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.273660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.274386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:48.274691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.276082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c178913-4598-4213-8786-efee9b0f55b6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.294943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 230/461] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:48.300715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84703ac-f346-473f-b845-414c855dd0fb None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.300715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84703ac-f346-473f-b845-414c855dd0fb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.300715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84703ac-f346-473f-b845-414c855dd0fb None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.300715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 231/462] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:48.302707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84703ac-f346-473f-b845-414c855dd0fb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.387934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c1f122-83c0-467a-8b9e-51685086785c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.417324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84703ac-f346-473f-b845-414c855dd0fb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.424222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WUdGE2ygRjyVzyttQ2aRlw, audit_chain_id=['WUdGE2ygRjyVzyttQ2aRlw']) at 0x7fe8a154c1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.425277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.425387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.425627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.437010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.438470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.452546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=gEJBaHvtRQqXA71CDwyHJw, audit_chain_id=['gEJBaHvtRQqXA71CDwyHJw']) at 0x7fe8a150a8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.453548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.454022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.454481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.455414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.457076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-b76a024a-2fab-4576-8a64-74ea6d573f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:48.457322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:48.458125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:48.458951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:48.458951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:48.458951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:48.458951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:48.463296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 232/463] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:48.465938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90ad7-4013-425b-aaf8-08862f54895a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.466226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90ad7-4013-425b-aaf8-08862f54895a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.466565 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90ad7-4013-425b-aaf8-08862f54895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.485222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0ca90ad7-4013-425b-aaf8-08862f54895a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:48.486675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0ca90ad7-4013-425b-aaf8-08862f54895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:48.491057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 232/464] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:48 2022] POST /identity/v3/users => generated 246 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:48.491057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.572088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 233/465] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:48.573666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0296-ef80-404d-b1d5-8c76aa7dd620 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.574688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0296-ef80-404d-b1d5-8c76aa7dd620 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.574962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f0296-ef80-404d-b1d5-8c76aa7dd620 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.576695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 234/466] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:48.581980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.582266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.582541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.622295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e009a-ea64-4137-a8de-7fa4fd899a2e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.623204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:48.625430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:48.660865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WUdGE2ygRjyVzyttQ2aRlw, audit_chain_id=['WUdGE2ygRjyVzyttQ2aRlw']) at 0x7fe8a14fa7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.661636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.661917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.662191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.663013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:48.663274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.664692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.684717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 233/467] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:48.686311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.712810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 235/468] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:48.713767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.813797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea2b78f-98c9-4a38-935f-13dd1f8e3dfb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.833494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff3f63-9fbb-47ad-8511-50b3eb1298e9 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:48.851293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KofyIzelQYSJl564pifYfg, audit_chain_id=['KofyIzelQYSJl564pifYfg']) at 0x7fe8a14fabb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.852091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.852372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.852644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.863103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.864493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.870579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WUdGE2ygRjyVzyttQ2aRlw, audit_chain_id=['WUdGE2ygRjyVzyttQ2aRlw']) at 0x7fe8a14ddbb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:48.871526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:48.872005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:48.872492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:48.873417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:48.875062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:48.883239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:48.884074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:48.884897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:48.884897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:48.884897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:48.884897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:48.884897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 234/469] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:48.885685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:48.900308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 236/470] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:48 2022] POST /identity/v3/users => generated 248 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:48.902530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:49.082526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7abe-e9cc-482a-973b-ffb36fe2276e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:49.118995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KofyIzelQYSJl564pifYfg, audit_chain_id=['KofyIzelQYSJl564pifYfg']) at 0x7fe8a14910d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:49.119982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.121196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.121677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.122661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:49.123242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:49.124888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:49.133532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a0f47-61e2-4d03-93e6-d96ab0477760 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:49.139480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 237/471] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:49.145023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:49.174658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P44w9veIRLCs1VLN1hwc2w, audit_chain_id=['P44w9veIRLCs1VLN1hwc2w']) at 0x7fe8a14c0760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:49.175457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.175920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.176193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.192430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:49.193933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:49.216216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:49.217354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:49.218324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:49.218324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:49.218324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:49.218324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:49.218324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 235/472] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:49.223893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:49.284326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19cf7a-6620-4ba4-be44-f83ec35e1497 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:49.336856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffd3e1-1ba9-4750-8da6-520f2ea83e70 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KofyIzelQYSJl564pifYfg, audit_chain_id=['KofyIzelQYSJl564pifYfg']) at 0x7fe8a14ee790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:49.337855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd3e1-1ba9-4750-8da6-520f2ea83e70 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.338324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd3e1-1ba9-4750-8da6-520f2ea83e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.339858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffd3e1-1ba9-4750-8da6-520f2ea83e70 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.340917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffd3e1-1ba9-4750-8da6-520f2ea83e70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:49.342637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ffd3e1-1ba9-4750-8da6-520f2ea83e70 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:49.365304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 238/473] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:49 2022] POST /identity/v3/users => generated 248 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:49.366725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67867-fc6c-410c-8f99-9ad0d56665d0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:49.366918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16019a53-69fc-439f-8817-e82bad6b3d8b None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.367369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16019a53-69fc-439f-8817-e82bad6b3d8b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.367714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16019a53-69fc-439f-8817-e82bad6b3d8b None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.369491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 239/474] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:49.375677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.375979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.377304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.418872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:49.421441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:49.450794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P44w9veIRLCs1VLN1hwc2w, audit_chain_id=['P44w9veIRLCs1VLN1hwc2w']) at 0x7fe8a1468ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:49.451910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.452193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.452465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.453228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:49.453535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:49.457018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:49.477149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 236/475] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:49.484199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:49.588822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 240/476] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:49.620756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:49.649765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7d6c8-b79e-4e42-bafb-c5dda178086a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:49.688766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P44w9veIRLCs1VLN1hwc2w, audit_chain_id=['P44w9veIRLCs1VLN1hwc2w']) at 0x7fe8a149e910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:49.690256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.690731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.691287 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.692240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:49.693977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:49.717771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 237/477] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:49 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:49.751746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf940-c582-4fa6-8e29-a90ff024aafc None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:49.800810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7gdo_YcTuCqLipMSu1vDg, audit_chain_id=['L7gdo_YcTuCqLipMSu1vDg']) at 0x7fe8a14e4c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:49.802006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:49.802509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:49.803010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:49.804011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:49.805711 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:49.819288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.sql.core [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<<null>>' for key 'role.ixu_role_name_domain_id'") May 13 12:40:49.819288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 12:40:49.819288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [parameters: {'id': '612eb6ed4f934321999730351ef2151a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 12:40:49.819288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86344) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application result = self._query(query) May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application conn.query(q) May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application result.read() May 13 12:40:49.837425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<<null>>' for key 'role.ixu_role_name_domain_id'") May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return ref.to_dict() May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 12:40:49.838373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application next(self.gen) May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application yield resource May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application next(self.gen) May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self.session.rollback() May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self.force_reraise() May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise self.value May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application session.commit() May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 12:40:49.839861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._prepare_impl() May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self.session.flush() May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._flush(objects) May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application compat.raise_( May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application flush_context.execute() May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rec.execute(self) May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 12:40:49.841194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 12:40:49.843794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application result = self._query(query) May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application conn.query(q) May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application result.read() May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 12:40:49.845778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<<null>>' for key 'role.ixu_role_name_domain_id'") May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [parameters: {'id': '612eb6ed4f934321999730351ef2151a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:49.847796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 13 12:40:49.849753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:49.853821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 241/478] 10.222.0.49 () {60 vars in 1131 bytes} [Fri May 13 12:40:49 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 12:40:49.860111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:49.990480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6381aa1-a1df-46fb-baa3-10c79768f3f4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:50.031121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702f6b-d14d-4a4c-88bd-096c80c66335 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7gdo_YcTuCqLipMSu1vDg, audit_chain_id=['L7gdo_YcTuCqLipMSu1vDg']) at 0x7fe8a1501c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:50.031938 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702f6b-d14d-4a4c-88bd-096c80c66335 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:50.032217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702f6b-d14d-4a4c-88bd-096c80c66335 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:50.032494 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702f6b-d14d-4a4c-88bd-096c80c66335 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:50.049716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702f6b-d14d-4a4c-88bd-096c80c66335 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-0c702f6b-d14d-4a4c-88bd-096c80c66335 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:50.057851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:50.058830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 13 12:40:50.059624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:50.060729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 238/479] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:40:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:50.066288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:50.183568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43074b-b3fb-4a13-a37f-f82adafe87ca None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:50.229131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7gdo_YcTuCqLipMSu1vDg, audit_chain_id=['L7gdo_YcTuCqLipMSu1vDg']) at 0x7fe8a14f16a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:50.230546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:50.230843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:50.231117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:50.231869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:50.232172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:50.233570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d53a22-7bc0-4f6f-91cf-f3328434b15b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:50.247471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 242/480] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:51.285856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378795f-d260-4852-9fde-f4580a462f96 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:51.286350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378795f-d260-4852-9fde-f4580a462f96 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:51.286350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378795f-d260-4852-9fde-f4580a462f96 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:51.287923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 239/481] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:51.293941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:51.294415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:51.294492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:51.312183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:51.313391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:51.381127 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 243/482] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:51.405535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378795f-d260-4852-9fde-f4580a462f96 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:51.540564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378795f-d260-4852-9fde-f4580a462f96 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:51.584846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845ff61-ecbf-45b8-ade7-ad8b7a5014a3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a1429430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:51.585670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845ff61-ecbf-45b8-ade7-ad8b7a5014a3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:51.585945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845ff61-ecbf-45b8-ade7-ad8b7a5014a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:51.586214 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845ff61-ecbf-45b8-ade7-ad8b7a5014a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:51.605395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f845ff61-ecbf-45b8-ade7-ad8b7a5014a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-f845ff61-ecbf-45b8-ade7-ad8b7a5014a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:51.613179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:51.614077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:51.614854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 240/483] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:51.620943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:51.637294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb70df-f110-4123-98a1-4e1cffad7ea8 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:51.637595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb70df-f110-4123-98a1-4e1cffad7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:51.637844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb70df-f110-4123-98a1-4e1cffad7ea8 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:51.643475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 241/484] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:51.644678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:51.644956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:51.645251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:51.681886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:51.683705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:51.790255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259273ab-88d7-476a-a66b-99250de6a8a3 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:51.823853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 242/485] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:51.833677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a1549dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:51.834351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:51.834628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:51.834900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:51.835647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:51.835947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:51.837408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:51.850846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 244/486] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:51.854450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:51.862449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.029346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea81f8a5-685f-4faa-9bf6-7ff5e54963a2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.050604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811459ef-045d-4ef4-b4fb-464158548dec None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.100926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a14f0040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.103592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.105988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.106476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.124139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a1531880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.124958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.128689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.128973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.131888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:52.145641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:52.146574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:52.147362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:52.154022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 243/487] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:52.155193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:52.156774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:52.160788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:52.196976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:52.197888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:52.199473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:52.199473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:52.199473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:52.199473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:52.201957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 245/488] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:52.204008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.300199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25308ed8-84f1-4e0f-a267-b5d64ccac117 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.337363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a1444fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.338018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.338298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.338572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.339361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:52.339672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:52.341199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:52.351320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 244/489] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:52.357015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.409917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524fb49-a587-417c-952e-a42f957c4d3d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.464263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a14ceb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.465559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.466355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.467111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.468248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:52.469131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:52.471119 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee178299-9748-4a55-8e3e-23fd7d64fdaf None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:52.474207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5c2d8-8cde-4d01-986c-d78881479dba None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.488834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 246/490] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:52.490903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780a2b-acab-4a11-abca-b716e4083742 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.491647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780a2b-acab-4a11-abca-b716e4083742 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.492172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780a2b-acab-4a11-abca-b716e4083742 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.498869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 247/491] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:52.498869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780a2b-acab-4a11-abca-b716e4083742 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.513763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a1490c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.514487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.514766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.515084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.528146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:52.529312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-7539c88c-7b21-414a-8c6e-417ad9fa8287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:52.547028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:52.547934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:52.549221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:52.549221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:52.549221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:52.549221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:52.549221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 245/492] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:52.554012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.554294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.554569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.572449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:52.574275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:52.627639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780a2b-acab-4a11-abca-b716e4083742 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.657006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 246/493] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:52.657006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.689455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a1499430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.691859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.693085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.693963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.712417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:52.714051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:40:52.731782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:52.732753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:52.734131 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 248/494] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:52.738701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.784327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc7b9-bde6-423b-897b-7550ad06bbab None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.819461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a14ffb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.820173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.820457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.820732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.821488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:52.821882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:52.824017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:52.840217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 247/495] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:52.841284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.865609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807d69-738c-4bcf-bb1a-567705d5e94b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:52.914405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a14b1640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:52.915662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:52.915778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:52.916105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:52.930273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:52.938847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:52.939889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:52.940942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 249/496] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:52.942345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:52.970144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182732ec-d692-4ebf-985d-3f86b7f25486 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.018013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a14e1220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.019156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.019678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.020348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.021556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:53.022083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.024516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.062095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dddd2-f507-4994-9bb4-27997e7a56dd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.091091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 248/497] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:53.091091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.096044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a14ced90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.096833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.097150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.097437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] PATH_INFO: `/v3/users/glance` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.105824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.107266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a6932eed-f655-48da-a0b4-7fabd1c639ba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:40:53.122134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:53.123463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 250/498] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a4fe-07f5-4473-b3c2-7c6b09743a29 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.124769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a4fe-07f5-4473-b3c2-7c6b09743a29 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.125840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2a4fe-07f5-4473-b3c2-7c6b09743a29 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.129030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 251/499] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:53.129030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d3bf-a9bc-4a0f-8a88-5fae8f9d5101 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.129030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d3bf-a9bc-4a0f-8a88-5fae8f9d5101 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.129030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09d3bf-a9bc-4a0f-8a88-5fae8f9d5101 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.129374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 252/500] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:53.129989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d3bf-a9bc-4a0f-8a88-5fae8f9d5101 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.197435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e12c68a-a67e-4df0-80fd-40fcd977fec0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.230883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a14e2a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.231549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.231832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.232113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.232850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:53.233187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.233287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09d3bf-a9bc-4a0f-8a88-5fae8f9d5101 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.234574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.242806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 249/501] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:53.243508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.271876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7780cc9-04df-4cfe-83ac-8ef2f9c3448e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a14a7d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.272517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780cc9-04df-4cfe-83ac-8ef2f9c3448e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.272794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780cc9-04df-4cfe-83ac-8ef2f9c3448e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.273100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7780cc9-04df-4cfe-83ac-8ef2f9c3448e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.344224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36083a1-08dd-4937-8a81-7f7c265b5083 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.351261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780cc9-04df-4cfe-83ac-8ef2f9c3448e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.352750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7780cc9-04df-4cfe-83ac-8ef2f9c3448e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.376290 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a158cfa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.376951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.377255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.377523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.378350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:53.378656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.380095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e75ef-d518-48b7-bb16-275e1058757e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.399965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 250/502] 10.222.0.49 () {56 vars in 1137 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:53.402298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.402623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.402922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.419414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:53.420608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:53.457706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 253/503] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:53.458938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.459208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.459485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.477653 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:53.478857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:53.486678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 251/504] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:53.487514 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.547726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 254/505] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:53.548395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.606082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445d8f4c-17d7-49a0-9e8b-ef323294cc9e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.639876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a157ca30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.640676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.640948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.641250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.651183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.653748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.658000 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8698ccd-6cb6-49a1-9b6e-c3ba142151c6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:53.671767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:53.672656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:53.673520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:53.673520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:53.673520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:53.673520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:53.673520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 252/506] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:53.674685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.695042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a14da550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.695692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.695972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.696236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.762871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.764337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.781119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdbebf4-df18-44b3-815b-5a21cdfb295f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.813674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a14e1220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.814469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.814744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.815014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.827018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:53.828479 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:53.846449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:53.847614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:53.848483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:53.848483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:53.848483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:53.848483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:53.848483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 253/507] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:53.848483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.867888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 255/508] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:53.869652 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:53.949972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9282f-99f7-48f4-b845-34092cc845a3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.971101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eee438-011d-4420-b722-81b60c085d06 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:53.987298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a1444fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:53.988083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:53.988354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:53.988672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:53.998872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:54.004433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mZ9_rRUDTt60JxNFkJH3pg, audit_chain_id=['mZ9_rRUDTt60JxNFkJH3pg']) at 0x7fe8a14f1700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.005250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.005532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.005802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:54.006409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:54.007424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 254/509] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:54.008375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.021594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.022988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:54.041830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:54.048884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:54.049936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:54.049936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:54.049936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:54.049936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:54.049936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 256/510] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:54.049936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.118316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90393c90-dffc-4e7f-a691-aa6938efdfac None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.152442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a1429370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.152787 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01997749-bf16-47ae-88ec-a0821250b600 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.153132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.153418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.153745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.154400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:54.154738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.156087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.169254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 255/511] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:54.169925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.188621 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a1499220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.189322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.189607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.189880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.190601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:54.190908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.192285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.203587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 257/512] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:54.204401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.273358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4a5df-b2d9-47a9-b2ad-a34c86de32d1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.304774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8c2ab-fbca-473c-a827-5706c60b3cf3 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.307216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a15688e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.308028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.308366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.308589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.318977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.320686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.341596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a14e4e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:54.341891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:54.343345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:54.345157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:54.345157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:54.345157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:54.345157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:54.345378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.345378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.345378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.345669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 256/513] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:54.345744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:54.345744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.345942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.346016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.355975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 258/514] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:54.356790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.445396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e8ce1-d534-4972-b314-58cf07decf95 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.459485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30d0e3-e316-49db-9117-1fc6b4faa98b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.482903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mZ9_rRUDTt60JxNFkJH3pg, audit_chain_id=['mZ9_rRUDTt60JxNFkJH3pg']) at 0x7fe8a13fc250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.483853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.484149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.484597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.485473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:54.485991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.487762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.493543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a14ee880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.494327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.494614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.494887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.503035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.503828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 257/515] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:54.504563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.505376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:40:54.521507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:54.522606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 259/516] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:54.523605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.610964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bbb805-702c-4f20-8dfc-fc1fb825ebab None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.632641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14455dff-1eab-4d39-a3c0-90080d23912c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.643771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a14fb340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.644553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.644826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.645160 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.652201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.653857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.667235 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a1459310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.667888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.668166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:40:54.668254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:54.669211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:54.670206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:54.670696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.670696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:54.670834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 258/517] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:54.670909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.670993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.671070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.688222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 260/518] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:54.689099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.774543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be35ea-a3eb-40a5-b2e1-cc2bd50283d9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.790524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0905643-84d1-4822-beba-04bfd201c497 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.809273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a13e94f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.810062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.810335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.810602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.820459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.821927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.822845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mZ9_rRUDTt60JxNFkJH3pg, audit_chain_id=['mZ9_rRUDTt60JxNFkJH3pg']) at 0x7fe8a1499a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:54.824154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:54.824529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:54.824789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:54.825662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:54.827326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:54.840924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:54.842076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:54.843079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:54.843079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:54.843079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:54.843079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:54.843079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 259/519] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:54.843498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.853021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 261/520] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:40:54 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:40:54.853021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:54.959634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ff9026-a3e0-4451-9454-f651f2296ae0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:54.971538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c2074-987b-457f-b746-dead3b1aaed8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.003329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a13e8a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.004009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.004285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.004608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.005506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.005811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.007262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.010625 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a14da250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.011593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.011871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.012338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.013196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.013508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.015046 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.028360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 260/521] 10.222.0.49 () {56 vars in 1137 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:55.029434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.037109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 262/522] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:55.038331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.147714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bd5e5-e3aa-441a-9a45-44aec34a403b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.161088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27016f-bccd-4500-90fd-5277971a1274 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.187519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a13dfa60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.188455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.188735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.189038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.196405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.197881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.205065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a14e03a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.205953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.206327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.206715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.207539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.207964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.209915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:40:55.212220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:55.213152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:55.214269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:55.218139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 261/523] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:55.219000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.223925 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 263/524] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:55.224974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.331904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b908dfe-8db0-4409-aaf7-1b84dac65475 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.338622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e5ecb-3dba-4017-95bf-a171a88a1d3b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.365973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a14c0e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.366632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.366935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.367157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.378391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=T_YYlhS2QSGo3DET-S0AWg, audit_chain_id=['T_YYlhS2QSGo3DET-S0AWg']) at 0x7fe8a15317c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.379288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.379715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.380164 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.381241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=97df92a4d0e543f79e611b9bfd03e1c3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.381637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.383355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.390860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 264/525] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/role_assignments?user.id=97df92a4d0e543f79e611b9bfd03e1c3&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:55.391765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.461197 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.463439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.514362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bc00b2-bd27-434c-a8f2-ddbdbb01de21 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.552057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a14da640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.553206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.553730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.554220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.555304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.555880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.558418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.572568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 265/526] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:55.574512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.591600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 262/527] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:55.592567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.694439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce16b2-554e-4dc1-a83b-af13f85c5d41 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.698693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40339bf9-d5c2-4b7e-8d82-7a670cbcbfbd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.738494 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=uuUEjxLIQVms52GPKVyc6g, audit_chain_id=['uuUEjxLIQVms52GPKVyc6g']) at 0x7fe8a142e4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.739534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.740030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.740638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.742076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=296ed9d38ea741b1bc2c72fc398b5009) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.742827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.743790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a123ae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.744596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.744873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.745279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.745683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.752647 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 263/528] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/role_assignments?user.id=296ed9d38ea741b1bc2c72fc398b5009&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:55.753923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.754692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.756171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:40:55.775929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:55.777599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:55.778511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 266/529] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:55.784253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:55.882124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae197a9b-5e2e-42d5-a2d5-e036e1add413 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.903992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c934c-8ab8-4b7a-8f96-580ece125c64 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:55.929632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a150af10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.931115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.931403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.931672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.944669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.946151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.947421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a14cbca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:55.948634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:55.949448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:55.950088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:55.951494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:55.952114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:55.954260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:55.966217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:55.967397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:55.968469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:55.968469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:55.968469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:55.968469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:55.968469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 264/530] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:55.975055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.010268 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 267/531] 10.222.0.49 () {56 vars in 1139 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:56.017459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.136518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a107e3d-a7e6-434b-a016-652a755feac8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.176080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4040be-d93e-49a8-89b2-2855bbf203c7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.196268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a13fc1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.196947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.197251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.197517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.198304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:56.198629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.200200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.212218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 265/532] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:56.217325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a1529c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.218028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.218318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.218610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.222256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.311733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.313245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.414925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa67c3-a4a4-4b12-a245-737092ebb267 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.422483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 268/533] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:56.423819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.476051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a1490a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.477421 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.478021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.478605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.493238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.505014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.525747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd2438d-9830-499e-aeea-bc5035bab8cc None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:40:56.533670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:56.534517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:56.535444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:56.546136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 266/534] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:56.551195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.568126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a1491220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.569054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.569261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.569508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.589968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.591465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:56.618506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:56.619449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:56.620299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:56.620299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:56.620299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:56.620299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:56.624299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 269/535] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:56.630045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.673388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432752d-5677-40e4-a7f2-d39117784db0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.714841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a14fa8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.716676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.717547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.721584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.723147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:56.723955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.725922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.762179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 267/536] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:56.768398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:56.844219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d9abbe-bace-4fc6-95a1-897288dc0530 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.881304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5ab90-99de-411c-9d6b-24cb4b5df2b3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:56.923032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lZn57h6HR4e-oDCRwAbAkA, audit_chain_id=['lZn57h6HR4e-oDCRwAbAkA']) at 0x7fe8a1457640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.924138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.924627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.925117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.926637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=eada5adaf6724be28208b8c7b0110e5c) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:56.927632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.929719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.935495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a11fc760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:56.936474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:56.936970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:56.937475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:56.938411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:56.938915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:56.941471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:56.943640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 268/537] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/role_assignments?user.id=eada5adaf6724be28208b8c7b0110e5c&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:56.968607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 270/538] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:56.978387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:57.110710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d3bae-6e6f-4305-aac7-026c43c114d4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:57.151977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a1457700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:57.152898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:57.153245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:57.153569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:57.162069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:57.163980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:40:57.188103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:57.188976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:57.189926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 269/539] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:40:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:57.198243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:57.331854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef11a2-9c92-47a5-8c84-adb1b2be3b4d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:57.389290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a14a7160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:57.389970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:57.390254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:57.390528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:57.391323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:57.391630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:57.393169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df240d5-9610-42b0-946a-748acf9eaa60 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:57.417116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 271/540] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:40:57.424955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:57.494788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4e0e9-3b6b-4005-9da2-42d73e29650c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:57.495113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4e0e9-3b6b-4005-9da2-42d73e29650c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:57.495425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4e0e9-3b6b-4005-9da2-42d73e29650c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:57.497861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 272/541] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:57.509020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:57.509388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:57.509808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:57.552766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:57.554028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:57.602138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356f3a24-6bfd-47d6-bd16-fa266c02dea0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:57.673664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 273/542] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:40:57.685457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=A2zrb0eWThCfCBUM8iNJrQ, audit_chain_id=['A2zrb0eWThCfCBUM8iNJrQ']) at 0x7fe8a13e8df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:57.686187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:57.686475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:57.686741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:57.687628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=40efb0126116472aabce8459ff59bae0) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:57.687928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:57.689565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:57.700761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 270/543] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:40:57 2022] GET /identity/v3/role_assignments?user.id=40efb0126116472aabce8459ff59bae0&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:57.701962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:57.831381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d88ed5-ee81-4a18-8ece-71eb4163afbf None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:57.876784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a1524ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:57.877640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:57.877914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:57.878176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:57.894747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:57.903742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:57.904680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:57.905502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:57.909724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 274/544] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:57.918403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:58.094299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc06ff1-26b4-486d-800e-961b13acbdd4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:58.144628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a14a3f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:58.145559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.145925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.146274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.147054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:58.147558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:58.150135 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:58.167979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 271/545] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:58.175146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:58.335234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812a756-f318-4eeb-8ef8-85e87dae88e7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:58.380783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a120b8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:58.381635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.381919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.382271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.395478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:58.397125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:58.417322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:58.418203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:58.419037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:58.419037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:58.419037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:58.419037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:58.419037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 275/546] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:58.425363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:58.580278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452bf66-f6ec-4529-a26a-69a82eb4fd8b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:58.615005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a14fa8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:58.615670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.615944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.616203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.616925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:58.617251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:58.618624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74ae20-5ea9-4615-b636-749ffd4b6dc0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:58.633765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 272/547] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:58.640406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:58.691536 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7f55-aca5-415b-8a66-4d0ac4dbc927 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.691857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7f55-aca5-415b-8a66-4d0ac4dbc927 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.692073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f7f55-aca5-415b-8a66-4d0ac4dbc927 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.693610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 273/548] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:40:58.710705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50604ffa-3e75-41ba-ac16-b94033c62548 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.711027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50604ffa-3e75-41ba-ac16-b94033c62548 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.711242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50604ffa-3e75-41ba-ac16-b94033c62548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.746464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-50604ffa-3e75-41ba-ac16-b94033c62548 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:58.747839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-50604ffa-3e75-41ba-ac16-b94033c62548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:58.824890 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399a747-a1db-4d7f-a86e-e4823db7042b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:58.869903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 274/549] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:58.871350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9fd1-694e-4792-859f-7fa83ed560f6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.871698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9fd1-694e-4792-859f-7fa83ed560f6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.871972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e9fd1-694e-4792-859f-7fa83ed560f6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.876622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a1202c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:58.877555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.877871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.878160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.881434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 275/550] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:58.889881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:58.890150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:58.890411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:58.891755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:58.893348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:40:58.910381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:58.912174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 276/551] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:40:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:58.914113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:58.919814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:40:58.921142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:40:59.009130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 276/552] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:40:59.010479 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.058362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b11da-bcb3-4e55-9bc8-f4cac0a1ec70 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.095257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14b43d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.096199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.096544 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.096820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.109505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:59.118008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:59.118879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:59.119651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:59.125469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 277/553] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:59.126221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.139791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f814d-1617-4ac8-b497-d9b85da15884 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.181017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a142e8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.181017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.181017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.181017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.181533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:59.181533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.181533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.206560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 277/554] 10.222.0.49 () {56 vars in 1135 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:59.207566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.235409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ea229d-3396-4b13-aac7-e5b6bbef2073 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.277763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a11fc7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.279266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.279885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.280160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.298280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:40:59.309168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:59.310137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:59.310974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 278/555] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:59.316783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.324453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a189ef-ccc8-4fc5-a756-c80a20ec4df6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.367502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14e5a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.368573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.369136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.369568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.371405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:59.371865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.373996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.384559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 278/556] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:59.386589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.443863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff249f86-e68f-4a54-856f-84879de23027 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.489355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a11d07c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.490139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.490548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.490822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.497424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd67c5-e263-4385-ba12-3678719c420b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.533362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a14c6c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.534263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.534371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.534560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.535569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:40:59.535785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.537253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.546753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 279/557] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:40:59.547736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.582407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.584661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.666768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb235e-a288-4846-b356-1a2fb1c67005 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.699744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 279/558] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:40:59.700780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.717203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14611c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.718361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.718951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.719362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.734107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.736372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:59.757476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:59.758530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:59.759543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:59.759543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:59.759543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:59.759543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:59.762352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 280/559] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:59.763287 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.824386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c180d-f6f6-4d4f-b3f4-34edeb7763f6 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.862178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a14ead60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.863064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.863789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.863789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.874408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.876155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.892078 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09ddf4-5efd-4513-bab3-688742f7850f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:59.895758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:59.898026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:59.901227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:59.901227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:59.901227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:59.901227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:40:59.901227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 280/560] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:59.901227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:40:59.934210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a139a670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:40:59.935284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.935558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.935827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.948063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:40:59.950138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6eccc5dd-0fe2-4d80-a9c0-e8505f9c0535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:40:59.970237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:40:59.971588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 281/561] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03cfe-9abd-40c3-a737-4d87f2bc07df None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03cfe-9abd-40c3-a737-4d87f2bc07df None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:40:59.972926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e03cfe-9abd-40c3-a737-4d87f2bc07df None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:40:59.973864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 282/562] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:40:59.974564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03cfe-9abd-40c3-a737-4d87f2bc07df None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.018757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6af2d-0ff8-4fef-bda2-f6c0fe17adff None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.054388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a1202610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.055054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.055333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.055601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.056319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:00.056619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.058052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08ff69-59ab-4b6c-83db-0a7d461abd15 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.071624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 281/563] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:00.073818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.074359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.074943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.086013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e03cfe-9abd-40c3-a737-4d87f2bc07df None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.092742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:00.093963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:00.126055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a14a3cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.126774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.127052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.127390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.128109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:00.128472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.130135 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.151196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 283/564] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:00.151196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.185008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 282/565] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:00.185008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.272048 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa66abb-73c3-457a-ae18-b4471ec6d3dd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.301853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d875e0-b7bb-48f2-982a-968d24ebc06f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.310784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a14c6400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.311446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.311726 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.311998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.312716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:00.313042 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.314428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.325859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 284/566] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:00.326738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.344658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14f4370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.345779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.346205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.346650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.355548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.357097 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:00.373210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:00.374941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 283/567] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:00.376061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.442942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142fe7bb-0609-4f4e-833a-fb74c73713df None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.481142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a14c64f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.482355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.482848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.483266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.491912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27194e6e-31c9-4a89-b707-bd8ee904e15d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.492073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.493602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:00.512022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:00.518255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 285/568] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:00.519265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.530786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a120b4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.531512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.531786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.532054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.542731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:00.550332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:00.551603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 284/569] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:00.553356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.640311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b8aaf3-516a-4e87-9f5e-73657c397689 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.652445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f524322f-c9a9-445c-b338-a3bc112d99ce None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.677898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a13aa4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.678683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.678955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.679220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.685997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.686819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14ea070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.687442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.687559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.687738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.688009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.688843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:00.689187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.690588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e9f015-79f2-4ced-b42a-e3673f2a65ed None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:00.702241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:00.703209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 286/570] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:00.704165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.708820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 285/571] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:00.710144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd393e-0195-4164-acf7-69401864e78d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.710436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd393e-0195-4164-acf7-69401864e78d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.710707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd393e-0195-4164-acf7-69401864e78d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.712032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 286/572] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:00.712919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd393e-0195-4164-acf7-69401864e78d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.805757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070f250-a1bf-43cc-8729-aca42f8e3387 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.814972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd393e-0195-4164-acf7-69401864e78d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.838250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a13e8940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.839510 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.839784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.840093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.840967 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:00.841331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.842719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.850419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a14b4070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:00.851173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:00.851496 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:00.851810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:00.852700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:00.853079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:00.854547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:00.860962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 287/573] 10.222.0.49 () {56 vars in 1137 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:00.861811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.867125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 287/574] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:00.867125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:00.971032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744ac9e-7d0c-461e-9d54-f895e450a404 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:00.977534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2bfd6-ed01-4740-8d3d-cb253e1c196d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.006754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a14c0430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.007408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.007684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.007959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.008738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:01.009083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.010501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855ef60-a65f-45d2-ab05-79cddf0295be None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.018859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14e3df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.019651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.019926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.020198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.022221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 288/575] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:01.023576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.023861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.024133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.031640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.033166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.044140 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:01.045375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:01.051085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:01.052205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:01.058319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:01.058319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:01.058319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:01.058319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:01.058319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 288/576] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:01.058319 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.111952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 289/577] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:01.112784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.149084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d15ba4-dbf8-4827-b1f0-389e8cd61019 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.182193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a1202700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.183116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.183397 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.183673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.194191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.195638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:01.212455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:01.213568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:01.215169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:01.215169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:01.215169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:01.215169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:01.215169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 289/578] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:01.215507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.217662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a660f-1bd9-4be6-9a77-4a40d7379b84 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.252767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a139ab20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.253577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.253857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.254125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.266252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.267710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:01.289251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:01.290482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:01.291408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:01.291408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:01.291408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:01.291408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:01.291408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 290/579] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:01.291408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.320262 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa86722e-6202-4efa-bdde-a3bd92714266 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.353682 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=g4bbhzo0QAyCjG0FVSoCiQ, audit_chain_id=['g4bbhzo0QAyCjG0FVSoCiQ']) at 0x7fe8a12020a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.354345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.355282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.355571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.356616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=7f48f833629541c2bbc718c2372e1c1b) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:01.356931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.358517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.364551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 290/580] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/role_assignments?user.id=7f48f833629541c2bbc718c2372e1c1b&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:01.365423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.399702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548fa84-bf54-40b6-a471-1a75eb4e272b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.437590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a1505cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.438269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.438550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.438823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.439559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:01.439855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.441277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.458968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 291/581] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:01.458968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.478959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836c3de-fba8-46d1-b327-2eb4d52394fb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.517313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a11d0a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.518120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.518402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.518772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.532405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:01.544257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:01.545574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:01.546408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 291/582] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:01.547098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.583869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5ac725-b135-4cd7-b1a5-5f7fcf15a3ae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a1457040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.622462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.622805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.623080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.623877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:01.624252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.625792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.645337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 292/583] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:01.645337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.664068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae3579-1912-48a9-b24f-e2c92ebd229e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.701070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a11fcfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.701725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.702008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.702278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.703003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:01.703301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.704688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.717712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 292/584] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:01.719481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.759437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919b121-1a82-4308-9126-1cc4c17a2f3f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.797358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a13b76d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.798149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.798439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.798705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.805514 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.806958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:01.821527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:01.822657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:01.823752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 293/585] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:01.824487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.833135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa034ef-d894-4b9c-80c7-546f5a99615c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.870212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a14b1370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.871159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.871159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.871159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.871977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:01.873036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.874084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:01.884304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 293/586] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:01.885354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:01.944363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183899b1-ec77-4d9c-999d-9a654d9fa223 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.985163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a13bfca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:01.985961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:01.986232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:01.986503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:01.994096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433eee91-d873-4282-af11-de4eaa0e239a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:01.995842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:01.997621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:02.012102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:02.013121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:02.014033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 294/587] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:02.014626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.035084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a14fb4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.036260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.036767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.037216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.045870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.047434 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:02.063375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:02.065284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 294/588] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:02.073949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.128356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa2052-6273-4b92-b5eb-9f0758adc2bb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.166711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a13dbb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.168080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.168291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.168492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.169403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:02.169638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.171153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.176559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656e553a-6423-4889-a533-b8ca3b5a3a57 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.190724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 295/589] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:02.190724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.211781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a11da370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.212583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.212864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.213165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.223965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.225688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:02.246413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:02.247626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:02.248556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:02.248556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:02.248556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:02.248556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:02.248556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 295/590] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:02.248556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.301137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444b5c5-cedc-407c-8dd7-a27b1335feb4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.335436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a13bf2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.336105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.336794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.337105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.338228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:02.338534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.340918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.348224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf5e8d-b92a-435a-87e9-e65506fc65b0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.363179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 296/591] 10.222.0.49 () {56 vars in 1137 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:02.363179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.383847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a14b4100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.384577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.384860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.385179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.386676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:02.387003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.388828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.401428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 296/592] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:02.402308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.468805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7de23-6719-4171-84c5-3681e90d0a44 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.505869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tIxt6L7XRCKCrKvIaTOjGg, audit_chain_id=['tIxt6L7XRCKCrKvIaTOjGg']) at 0x7fe8a14fae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.506790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.507071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.507335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/97df92a4d0e543f79e611b9bfd03e1c3/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.514515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff4c8a5-cb15-4f14-acc6-662e72f94ec7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.522364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=97df92a4d0e543f79e611b9bfd03e1c3, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.523816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.538003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 297/593] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:02 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/97df92a4d0e543f79e611b9bfd03e1c3/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:41:02.538831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.558676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a14a73a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.559455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.559742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.560125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.560960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:02.561406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.563056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.578716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 297/594] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:02.579576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.682457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d67316-7419-49d2-8ec5-2b89d4618841 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.697197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2255e-24fb-49e9-b0ca-6ad6f07a8e10 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.723580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a14fa5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.724930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.725562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.726118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.737762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jHTw31vITDSGHF1jMDwn-Q, audit_chain_id=['jHTw31vITDSGHF1jMDwn-Q']) at 0x7fe8a119a850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.738732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.739035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.739324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/296ed9d38ea741b1bc2c72fc398b5009/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.742886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.744659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.757380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=296ed9d38ea741b1bc2c72fc398b5009, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.759018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:02.765034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:02.766069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:02.767070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:02.767070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:02.767070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:02.767070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:02.767501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 298/595] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:02.768850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.778838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 298/596] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:02 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/296ed9d38ea741b1bc2c72fc398b5009/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:41:02.780173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.892095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2411d9f-a6b5-4b1a-bdc0-707f33b28634 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.898878 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c050ab6-cece-436a-850b-796ec0ce5efc None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:02.935705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a13fc610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.936454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.936727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.937018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.940029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a14da250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:02.941164 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:02.941649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:02.942113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:02.943081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:02.943608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.945268 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.945515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:02.947091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:02.960075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 299/597] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:02.969446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:02.970454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:02.971388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 299/598] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:02.972523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:02.982390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.148736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e87d7a-e3bb-4278-91bf-badccf29110b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:03.150814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80f3375-10bc-43b5-95a1-5bb783efd1a4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:03.189397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a1429c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:03.189585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a14cb850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:03.190304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.190586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.190861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.191133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.191778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.192236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.193303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:03.193812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:03.195437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:03.198147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:03.200278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:03.215855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 300/599] 10.222.0.49 () {56 vars in 1139 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:03.225069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:03.226214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:03.227301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 300/600] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:03.228951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.229168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.395080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04499fde-8515-4ff3-9663-81de5a68b227 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:03.416127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a841-02b2-4674-bcbc-e2ebb4304a98 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:03.437011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a11ed910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:03.437011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.437011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.437011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.437443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:03.437443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:03.437443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:03.454377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 301/601] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:03.457188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.472006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a13dfe80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:03.473201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.473701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.474130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.494006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:03.496269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:03.533010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:03.534152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:03.535358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:03.535358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:03.535358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:03.535358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:03.537406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 301/602] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:03.543680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.577839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35654902-77f1-4a75-bb70-39052cfa2326 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:03.614359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136277f-398b-449b-8cf1-13a66d5e4554 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nqzM4xadQv6rpQMHbyCNAw, audit_chain_id=['nqzM4xadQv6rpQMHbyCNAw']) at 0x7fe8a14a7d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:03.615429 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136277f-398b-449b-8cf1-13a66d5e4554 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.615806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136277f-398b-449b-8cf1-13a66d5e4554 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.616216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136277f-398b-449b-8cf1-13a66d5e4554 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/eada5adaf6724be28208b8c7b0110e5c/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.632129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136277f-398b-449b-8cf1-13a66d5e4554 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=eada5adaf6724be28208b8c7b0110e5c, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:03.633825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6136277f-398b-449b-8cf1-13a66d5e4554 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:03.667228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 302/603] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:03 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/eada5adaf6724be28208b8c7b0110e5c/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:41:03.700466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411dc8-ea75-441f-8daf-0abaf3351222 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.700757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411dc8-ea75-441f-8daf-0abaf3351222 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.701067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b411dc8-ea75-441f-8daf-0abaf3351222 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.703006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 303/604] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:03.706646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d513b5-2032-4586-b51d-110bb7c0bbe6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:03.712520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.712976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.713387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.751604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:03.753181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:03.786071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a1429580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:03.787080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:03.788377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:03.788794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:03.790593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:03.791198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:03.795269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:03.821423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 302/605] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:03.827690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.893943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 304/606] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:41:03.916795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:03.981263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b7f47-c0f5-42a0-9f71-4f43cd15e4c0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.029432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a14dc490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.034611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.035003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.035431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.050892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:04.052598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:04.087506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c207dd-1115-4033-8d36-493e5126cb0c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:04.090364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:04.091417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:04.092317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 303/607] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:04.098484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:04.125867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a14e9bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.126838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.127240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.127619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.140561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:04.148877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:04.150248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:04.152509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:04.157135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 305/608] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:04.158991 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:04.267151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46a049-94d9-4fb9-8062-4f6f4898da4b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.310219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a138f2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.310897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.311176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.311447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.312394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:04.312716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:04.317006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:04.328064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 304/609] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:04.335655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:04.343313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6939ed-41dc-4a0e-aac2-65c83f21865c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.419378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a11fc6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.420441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.420920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.421404 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.422381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:04.422883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:04.424450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:04.443511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2ab873-aa44-46e3-91f4-f5b5096e2fa9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.452456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 306/610] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:04.457931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:04.478227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wgnEkOh2SYyEsdDSKh5vKg, audit_chain_id=['wgnEkOh2SYyEsdDSKh5vKg']) at 0x7fe8a131f280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.479127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.479912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.480406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/40efb0126116472aabce8459ff59bae0/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.496895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=40efb0126116472aabce8459ff59bae0, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:04.498406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:04.518563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 305/611] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:04 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/40efb0126116472aabce8459ff59bae0/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:41:04.627668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d30bc-3ed7-472a-961b-2767d5b44063 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.670340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a11edc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.671134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.671452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.671756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.685135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:04.686860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:04.708971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:04.709933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:04.710806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:04.710806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:04.710806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:04.710806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:04.711022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 307/612] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:04.718577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:04.835366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68bd6f-ebbc-422e-a3bc-71b6e7f71ee3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:04.875175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a139a1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:04.875976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:04.876360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:04.876693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:04.877656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:04.878075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:04.879618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:04.893646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 306/613] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:04.899005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:05.047900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0be9b98-561b-4ddc-ba5b-31e0dd40ccbe None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:05.096884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a11905e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:05.097666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.097952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.098278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:05.113488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:05.114962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:05.134234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:05.135219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:05.137124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 308/614] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:05.141569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:05.249870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7597b90-6e4a-4825-8426-2468ffcf8432 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:05.284444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591935-4854-4645-b412-b33b06377529 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a139a040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:05.285548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591935-4854-4645-b412-b33b06377529 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.286027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591935-4854-4645-b412-b33b06377529 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.286521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89591935-4854-4645-b412-b33b06377529 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:05.287543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89591935-4854-4645-b412-b33b06377529 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:05.288040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89591935-4854-4645-b412-b33b06377529 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:05.289690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89591935-4854-4645-b412-b33b06377529 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:05.311045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 307/615] 10.222.0.49 () {56 vars in 1135 bytes} [Fri May 13 12:41:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:05.318096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:05.483208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9bb82b-be1c-45af-b88e-da3e15c7b79a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:05.534499 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a120b280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:05.535345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.535632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.535905 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:05.553125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:05.554575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-eb4dd84e-8edd-429c-a4cc-76be55617414 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:05.580080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:05.581042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:05.581923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:05.581923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:05.581923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:05.581923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:05.581923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 309/616] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:05.587580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591935-4854-4645-b412-b33b06377529 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:05.623139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf433b-6c52-4d90-88bb-4eafcf81df53 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.623487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf433b-6c52-4d90-88bb-4eafcf81df53 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.623773 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf433b-6c52-4d90-88bb-4eafcf81df53 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:05.625391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 310/617] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:05.638006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.638272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.638548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:05.669042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:05.673060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:05.760366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89591935-4854-4645-b412-b33b06377529 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:05.767335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 311/618] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:41:05.791024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:05.805050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a1429d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:05.805050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.805050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.805050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:05.805496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:05.805496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:05.805496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:05.821136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 308/619] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:05.821136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:05.942534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29dcd1-3043-4914-b9f6-37d666d5ce8c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:05.998120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88631a01-f28f-4c98-bc4d-ff458a9abad9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a11e9400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:05.998982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88631a01-f28f-4c98-bc4d-ff458a9abad9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:05.999273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88631a01-f28f-4c98-bc4d-ff458a9abad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:05.999550 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88631a01-f28f-4c98-bc4d-ff458a9abad9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.013675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88631a01-f28f-4c98-bc4d-ff458a9abad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:06.022234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864441b-fa4c-47fa-acf0-015a37fb8bf9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-88631a01-f28f-4c98-bc4d-ff458a9abad9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:06.023553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:06.025285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:06.027582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:06.028760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 312/620] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:06.029676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c874-1b88-46c5-a193-b6f1a63100b8 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.029676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c874-1b88-46c5-a193-b6f1a63100b8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.029676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e4c874-1b88-46c5-a193-b6f1a63100b8 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.035451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 313/621] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:06.036305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c874-1b88-46c5-a193-b6f1a63100b8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.077449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a1457d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.078424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.078840 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.079118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.093136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.094598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-d4bbc41c-a737-4368-89bc-700d744b61a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:06.109487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:06.112397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 309/622] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.114889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.116162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.131939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:06.133302 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:06.167252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e4c874-1b88-46c5-a193-b6f1a63100b8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.212598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 310/623] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:06.213694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.219688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a120b400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.220423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.220707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.222224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.222995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:06.225988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.227517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.246139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 314/624] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:06.247418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.350176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aea02-51c0-431a-b165-a5bf9d6a1709 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.353475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07896cac-c953-4e92-a65f-5083bd50bec0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.392308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a1509f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.393184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.393565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.394027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.394912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:06.395316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.397059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.397182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a14a7b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.397906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.398187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.398460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.412225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:06.415420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 311/625] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:06.416391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:06.422402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:06.423978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 315/626] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:06.425474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.534678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50a69f-9261-418c-8168-835d3dc62226 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.547611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd4ecb-baac-495f-a7bb-cbc440dc48b8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.572380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=pyO7moPUQtWM3A_A6uWgjg, audit_chain_id=['pyO7moPUQtWM3A_A6uWgjg']) at 0x7fe8a12021c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.574150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.574433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.574706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/7f48f833629541c2bbc718c2372e1c1b/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.582089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a1468670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.582882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.583164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.583434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.589902 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=7f48f833629541c2bbc718c2372e1c1b, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.591435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.595728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.597411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.605251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 316/627] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:06 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/7f48f833629541c2bbc718c2372e1c1b/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:41:06.606006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4f724ba4-7068-40ea-a4df-d189f4e07032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:06.628129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:06.629145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:06.630035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:06.630035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:06.630035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:06.630035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:06.631450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 312/628] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:06.633288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314659-0258-4233-9d76-44754ee22066 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.633576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314659-0258-4233-9d76-44754ee22066 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.633848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02314659-0258-4233-9d76-44754ee22066 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.640520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 313/629] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:06.641575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314659-0258-4233-9d76-44754ee22066 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.752632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a860b97d-19c6-4f3d-b244-b42fa6c5abe9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.760472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02314659-0258-4233-9d76-44754ee22066 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:06.793115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a14a7eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.794037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.794320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.794595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.795372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:06.795679 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.797103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7824396e-40c6-49d5-b9ea-758112b8334b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.801959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a13b7b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:06.802989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.803471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.803937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.804900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:06.805240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:06.806623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:06.807412 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 317/630] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:06.809367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:06.809662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:06.809938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:06.820895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 314/631] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:06.821791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.826825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:06.828098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:06.912836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 318/632] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:06.913742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:06.972035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a4bdd-f43b-49f3-8186-3a2721fffdf1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.013172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a13aa6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.014503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.014791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.015070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.028511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.030009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:07.052570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:07.054521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:07.056699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:07.056699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:07.056699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:07.056699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:07.056699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 315/633] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:07.056699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.132472 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf324d-1064-4f3c-95bf-a908b89be917 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.183977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee4568d-8a2d-48a9-bc9d-f37a708997cd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.187690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a1459b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.188577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.188968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.189256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.196926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.198513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:07.213399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:07.215880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 319/634] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:41:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:07.218853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.221005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a13bf760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.221005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.221005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.221005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.233012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:07.237558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:07.240431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 316/635] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:07.243195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.328386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c01c69-6ea8-4faf-9813-31e64b435a8b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.352223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05303622-991a-433f-b78f-025b61108bd1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.363674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a120be20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.364341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.364628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.364903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.365667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:07.365972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.367345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.379669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 320/636] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:07.380539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.389135 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a13bff40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.389813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.390095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.390373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.391224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:07.391533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.393006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.412659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 317/637] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:07.413570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.488029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fa697-cf16-4d0b-88f5-70113bea8197 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.523613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d2280-2f98-44f7-9e8d-8fa7695d4668 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.525866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a1499c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.526689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.527103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.527383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.528134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:07.528449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.529853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.538719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 321/638] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:07.539540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.575970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a1444a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.577239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.577717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.578184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] PATH_INFO: `/v3/users/glance` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.591611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.594218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-19e3f76b-d0b6-4256-b878-a0d5c03248ea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:07.610319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:07.611314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 13 12:41:07.612275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:07.617118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 318/639] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:07.618391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeb9a3-aa45-4393-86c8-abc4f876b0d9 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.618676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeb9a3-aa45-4393-86c8-abc4f876b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.618949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eeb9a3-aa45-4393-86c8-abc4f876b0d9 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.620448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 319/640] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:07.621792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeb9a3-aa45-4393-86c8-abc4f876b0d9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.668283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85900de-d05b-4f70-842b-2b31b438ed09 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.708051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053e519-af87-4424-bb99-5358693a742f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a14ea070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.708732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e519-af87-4424-bb99-5358693a742f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.709031 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e519-af87-4424-bb99-5358693a742f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.709308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053e519-af87-4424-bb99-5358693a742f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.727448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eeb9a3-aa45-4393-86c8-abc4f876b0d9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.777775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a1330880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.779096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.779563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e519-af87-4424-bb99-5358693a742f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.779668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.780026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.781154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053e519-af87-4424-bb99-5358693a742f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.797749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.800335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:07.831523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:07.832737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:07.833722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:07.833722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:07.833722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:07.833722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:07.833722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 320/641] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:07.834980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:07.913600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 322/642] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:07.915574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.916023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.916441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.940501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:07.942501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:07.946227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed54ed1-7be9-45f1-b739-df6dc3dcc176 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:07.984946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a13db940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:07.985722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:07.985936 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:07.986178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:07.987021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:07.987331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:07.988872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.007587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 321/643] 10.222.0.49 () {56 vars in 1137 bytes} [Fri May 13 12:41:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:08.008522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.035576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 323/644] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:08.045882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.131679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40589156-f124-43a0-8491-362b6a374c88 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.182762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a13b7700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.183621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.184065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.184524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.185791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:08.186303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.187810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a7579-5950-454b-bfff-b5b46b106296 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.188675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.207379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 322/645] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:08.208616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.249134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a14a7e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.250696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.251267 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.251948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.268307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.270977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:08.300445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:08.302109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:08.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:08.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:08.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:08.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:08.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 324/646] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:08.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.349503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c1c5f-93ac-4aa9-8744-d91d6469babf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.384504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a13e8400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.385177 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.385451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.386599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.425400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d40b4-4955-432e-a674-ba076e4c4a0f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.465646 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a11fccd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.466388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.466716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.467051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.468727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.471145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.479013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:08.487932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:08.489169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:08.490112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:08.490744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 325/647] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:08.491979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.598357 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 323/648] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:08.599409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.615979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c888ba6-e2ef-4424-88d1-9d1249a3a6b8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.656145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a11fc4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.657100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.657445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.657776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.667562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.669404 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:08.687161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:08.688338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:41:08.689419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:08.689957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 326/649] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:08.691278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.724836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4bb40-ec3d-4560-9cb4-013f0c23c399 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.766210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a14a36a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.767065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.767466 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.767812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.768587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:08.768960 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.770682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.784292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 324/650] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:08.785701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.817140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec19f4c-d6f0-4564-b2d2-6f146c207d8a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.860901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a120bc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.861964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.862397 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.863166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.864438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:08.864888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.866581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:08.877398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 327/651] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:08.878839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:08.908897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702182a-77be-4788-bd6e-a91da6f5fa08 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:08.957974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a1444f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:08.958842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:08.959118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:08.959388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:08.976643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:08.978635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:09.005226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:09.006200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:09.007080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:09.007080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:09.007080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:09.007080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:09.007080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 325/652] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:09.008306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.032022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674d5aa6-b7f8-4043-805f-285e9e8a740b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.078965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a1464850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.079816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.080152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.080483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.081537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:09.081917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.083644 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.110841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 328/653] 10.222.0.49 () {56 vars in 1137 bytes} [Fri May 13 12:41:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:09.110841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.145485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55635e-03fc-4bec-a919-270c895d3167 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.195137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a1568dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.196559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.196951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.197423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.207526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.209901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:09.233734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:09.234691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:09.235574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:09.241022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 326/654] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:09.241022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.244046 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca308-7292-4fa7-9b5b-e9a67fa55919 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.279271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a123a0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.280061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.280341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.280613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.291058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.292566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-c1145000-39ac-4c39-99a0-7162edfd4639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:09.312211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:09.314048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 329/655] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfefb-a3c2-4d97-9949-6b2be7925319 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfefb-a3c2-4d97-9949-6b2be7925319 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.315771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cfefb-a3c2-4d97-9949-6b2be7925319 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.317282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 330/656] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:09.317532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cfefb-a3c2-4d97-9949-6b2be7925319 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.349239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a560e2-e2b0-409b-b6e6-927ee9fc7480 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.388823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a132d520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.389523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.389796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.390062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.390771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:09.391069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.392433 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.405566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 327/657] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:09.406308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.438394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cfefb-a3c2-4d97-9949-6b2be7925319 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.488736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcafce8-41ca-45dd-b17a-8f1e1344f8c9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a11ed550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.489791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafce8-41ca-45dd-b17a-8f1e1344f8c9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.490248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafce8-41ca-45dd-b17a-8f1e1344f8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.490702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcafce8-41ca-45dd-b17a-8f1e1344f8c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.531193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4508fc-0d23-40f1-b92b-dc8072b0d9c0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.558536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafce8-41ca-45dd-b17a-8f1e1344f8c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.560160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcafce8-41ca-45dd-b17a-8f1e1344f8c9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.565473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a13bf130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.566141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.566418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.566688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.567466 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:09.567768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.569310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.581897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 328/658] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:09.583205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.700039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 331/659] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:09.702160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.702623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.703082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.727513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:09.729240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a0b854-317d-440b-a5a1-210b5cb50298 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.729373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:09.767042 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a13b76a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.767705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.768019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.768288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.769212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:09.769666 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.771472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.782716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 329/660] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:09.783533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.803531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 332/661] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:09.804660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.886001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe33e93-6dcc-41e5-8e7d-f73e4214d778 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.913038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e5013-5890-45bb-b6bc-0f96bb7d0da5 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:09.919531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a15091c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.920317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.920595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.920865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.927692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.929304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:09.944093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:09.945080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:09.945975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 330/662] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:09.946466 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:09.954686 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=x8nzrKnJQ-CiUjcTU1UQBQ, audit_chain_id=['x8nzrKnJQ-CiUjcTU1UQBQ']) at 0x7fe8a14fb400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:09.955262 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:09.955543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:09.955816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:09.956660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=97df92a4d0e543f79e611b9bfd03e1c3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:09.956976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:09.958448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:09.966823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 333/663] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/role_assignments?user.id=97df92a4d0e543f79e611b9bfd03e1c3&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:09.968396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.085203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb9dcc-a343-4e90-9d57-0b1b487b7e78 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.125592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6a2b96-92f8-4ca3-bb53-55af7f8264ac None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.126692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a1568af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.127938 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.128396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.128851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.144771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.146442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:10.168223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:10.169971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:10.171585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:10.171585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:10.171585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:10.171585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:10.171585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 331/664] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:10.171585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.174415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a1491220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.175213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.175492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.175768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.185280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.186809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:10.203187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:10.204348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 334/665] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:10.205516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.314165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279063b7-6c94-45b5-b093-fcf23a94cb30 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.320535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b80be-bb50-452e-b851-77cf8ff34abe None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.360310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a115aa00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.361395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.361851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.362273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.363483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:10.363942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.365685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.369783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a1457a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.371916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.372396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.372844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.387956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 335/666] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:10.387956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.389371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:10.396918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:10.397864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:10.398694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 332/667] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:10.399477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.505707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e03a29-e872-449b-924b-b1c897f9a83b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.545232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a1202250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.545901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.546180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.546452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.547169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:10.547471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.547936 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cce9ee-facf-4006-80a2-c48fa64462cb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.548833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.564527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:10.564527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.592891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a13aaa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.593605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.593883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.594153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.594977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:10.595281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.596711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.614050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 333/669] 10.222.0.49 () {56 vars in 1139 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:10.615320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.681806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1808505-0ad9-49c4-8048-ea502082b461 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.717299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wcPzOupGQlOlmbyg_INPQw, audit_chain_id=['wcPzOupGQlOlmbyg_INPQw']) at 0x7fe8a14647c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.718336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.718820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.719336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.720157 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=296ed9d38ea741b1bc2c72fc398b5009) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:10.720465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.721928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.728033 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 337/670] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/role_assignments?user.id=296ed9d38ea741b1bc2c72fc398b5009&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:10.728846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.787315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fce287-3dbe-437b-9646-36d63b727ebc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.850224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e7cc10-d05c-448c-b9d7-ed5a77ba00b1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:10.852972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a150ac10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.854610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.855614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.856306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.858017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:10.858868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.861777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.878969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 334/671] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:10.881624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:10.892694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a14b1cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:10.894065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:10.894536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:10.895054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:10.908167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:10.910936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:10.942048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:10.943748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 338/672] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:10.946067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.045116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b654b13-1822-447b-b634-6144319e8ae6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.068367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5558e5-23c6-4b4a-a22c-dbd1d7bfdee6 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.098951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a1429ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.099971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.100437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.100893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.108916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a14fb4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.109807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.110106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.110362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.122555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.124029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:11.143465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:11.145607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:11.148555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:11.148555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:11.148555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:11.148555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:11.148555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 339/673] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:11.148555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.228211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.236942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.265950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe58ef-e698-48cf-b834-9b615e6a3de6 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.317415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a11daca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.318301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.318721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.319145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.320415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:11.320889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.323843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.344244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 340/674] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:11.352462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.408529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 335/675] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:11.410007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.485912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a42a1a-2cf5-493f-89e3-7166a6343577 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.523264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a120b190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.524082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.524367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.524692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.525451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:11.525756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.527651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.544433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 341/676] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:11.545405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.582583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63078e6e-fd6a-4f7b-94df-18c9bb346719 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.644107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P6_IFOrmRgSlh4P0J2vEag, audit_chain_id=['P6_IFOrmRgSlh4P0J2vEag']) at 0x7fe8a142e0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.645565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.646040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.647277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.648638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=eada5adaf6724be28208b8c7b0110e5c) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:11.649527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.653384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.654426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc5182-6d18-48ab-8208-f96448da54d2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.667925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 336/677] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/role_assignments?user.id=eada5adaf6724be28208b8c7b0110e5c&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:11.669494 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.726095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a1549460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.727976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.728728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.729201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.753873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.757397 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:11.794995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:11.798191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:11.801555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:11.801555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:11.801555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:11.801555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:11.801555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 342/678] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:11.805148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:11.828360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffa43b-243d-4ca1-8250-0b26b9f19550 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:11.914796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a1444f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:11.915690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:11.915972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:11.916240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:11.934612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:11.936145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:11.961918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:11.965735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:11.968706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:11.974905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 337/679] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:11.976755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:12.138344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba819d4-5717-4ae9-af26-ab5e070b8ee4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.186412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2306311-e77e-4836-af6a-6c375ec45389 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.207084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a11c0eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:12.208097 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.208527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.208948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.210121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:12.210592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:12.212706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:12.231761 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 343/680] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:12.232538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a1338340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:12.233254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.233536 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.233808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.234665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:12.234973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:12.236444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:12.239551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:12.256615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 338/681] 10.222.0.49 () {56 vars in 1135 bytes} [Fri May 13 12:41:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:12.262679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:12.361982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61711f48-c74a-46b0-95df-f9b1fac7ee89 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.406018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a119a520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:12.406885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.407165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.407436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.421331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:12.422796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:12.446951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:12.451500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 344/682] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:12.456617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:12.480360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24196aa-29a3-4724-be4d-44cd7c93ccf2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.562817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84420914-3dac-445a-96a2-42259836b1f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a15074f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:12.563776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420914-3dac-445a-96a2-42259836b1f9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.564198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420914-3dac-445a-96a2-42259836b1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.564598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84420914-3dac-445a-96a2-42259836b1f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.593121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d6c653-46ec-435b-81d6-2112280b29f9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.637775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a11c0040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:12.643212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.645500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.645988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.647023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:12.648714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:12.650384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:12.674661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 345/683] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:12.683702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:12.705540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84420914-3dac-445a-96a2-42259836b1f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:12.705540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84420914-3dac-445a-96a2-42259836b1f9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:12.843014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 339/684] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:12.844465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7608-2b28-41b8-9892-02d06fc9a225 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.849340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7608-2b28-41b8-9892-02d06fc9a225 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.849488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27da7608-2b28-41b8-9892-02d06fc9a225 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.851188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 340/685] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:12.851954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7608-2b28-41b8-9892-02d06fc9a225 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:12.871423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a695bf-d288-4037-85f6-4d779692bdd5 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.919004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7oBuUmJQSge8ZHC1Oda8RQ, audit_chain_id=['7oBuUmJQSge8ZHC1Oda8RQ']) at 0x7fe8a14a7f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:12.920221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.921237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.921713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.923009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=40efb0126116472aabce8459ff59bae0) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:12.923705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:12.926236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ab7c5d-297c-4287-ae38-c6cfcb5eeb51 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:12.936433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 346/686] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:12 2022] GET /identity/v3/role_assignments?user.id=40efb0126116472aabce8459ff59bae0&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:12.938836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:12.939324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:12.939920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:12.957689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27da7608-2b28-41b8-9892-02d06fc9a225 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:12.963191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:12.965306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:12.999468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a142e190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.000286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.000567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.000843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.013228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:13.015173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:13.034594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:13.035581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:13.036946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:13.036946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:13.036946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:13.036946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:13.036946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 341/687] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:13.041638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.055147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 347/688] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:13.102721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.162701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e728e91-7177-4503-b3e1-05cbee72ddbf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.208098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a13dfd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.208713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.208967 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.213011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.213011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:13.213011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:13.213011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:13.233110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 342/689] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:13.234734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.303411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ac5606-4aa3-463d-ace1-624c2a4b0882 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.340610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dd073-1b7b-4146-9623-ce558d784133 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.359460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a14b1490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.360764 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.361285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.361763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.377297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a19ba0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.377967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:13.378424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.378504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.378731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.386964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:13.389056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:13.392487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:13.393464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:13.394304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:13.396550 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 348/690] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:13.401903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:13.404211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:13.405956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:13.407775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 343/691] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:13.417405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.522367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ef452-ed22-4577-9c86-eaf3572f1d28 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.558489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a14c0ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.559334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.559621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.559902 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.560705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:13.561035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:13.563241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:13.568834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6db4dc0-9452-4a66-ad7c-4edd3803e4a8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.576336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 344/692] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:13.582411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.665296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a1491040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.666657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.667947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.668617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.670079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:13.670791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:13.673260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:13.702654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 349/693] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:13.706725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09046ed3-22dc-4be0-93d2-1a4477a5ca5d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.708275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:13.749879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fOIYVvITRLyfcgxskjBcjQ, audit_chain_id=['fOIYVvITRLyfcgxskjBcjQ']) at 0x7fe8a14c6040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.750546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.750876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.751156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:13.751993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=7f48f833629541c2bbc718c2372e1c1b) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:13.752304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:13.757011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:13.760710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 345/694] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/role_assignments?user.id=7f48f833629541c2bbc718c2372e1c1b&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:13.925683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f8303-a856-41e7-9511-7f2f24b128cc None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:13.992770 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a11fcd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:13.994094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:13.994516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:13.995548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.019671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:14.022146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:14.051753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:14.052700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:14.053601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:14.053601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:14.053601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:14.053601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:14.054110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 350/695] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:14.060014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:14.177383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69c9a9-2166-4666-8edc-1fb330229bef None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:14.219216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a1468760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:14.220106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.220195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.220420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.221176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:14.221482 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:14.222919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24aeda-7219-4a58-ada2-b770bef06b9f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:14.240411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 346/696] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:14.247041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:14.308401 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320b14-e1b1-4a2a-b6c4-8e6f264c8cf0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.308713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320b14-e1b1-4a2a-b6c4-8e6f264c8cf0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.309047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc320b14-e1b1-4a2a-b6c4-8e6f264c8cf0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.310701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 347/697] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:14.315998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.316281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.316564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.334474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:14.335691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:14.378324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc62b13-9220-4b86-bbb0-70ae730eed0b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:14.416576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 348/698] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:14.440528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a1499c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:14.441296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.441581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.441859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.451104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:14.452571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:14.467180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:14.467899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:14.468871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:14.470422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 351/699] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:41:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:14.475415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:14.664124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae6bb5-ed80-4398-ba47-e0683e8992eb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:14.668189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d816b2-0804-4584-86e2-0061950ab493 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:14.730452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a115ac10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:14.731238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.731521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.731794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.732640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:14.732947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:14.734404 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:14.737830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zrLGQXXjTNuYSZKf3pWTgQ, audit_chain_id=['zrLGQXXjTNuYSZKf3pWTgQ']) at 0x7fe8a13e9820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:14.738677 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.738900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.739172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.763373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:14.764843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:14.782533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 352/700] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:41:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:14.785287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:14.793832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:14.795989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:14.798170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:14.798170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:14.798170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:14.798170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:14.798170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 349/701] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:14.802911 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:14.889748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7d244-0593-47b6-a287-b65c3f949997 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:14.949821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a14b1610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:14.950487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:14.950771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:14.951041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:14.953711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bf70-4182-4e72-819f-0a249239414b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.002623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zrLGQXXjTNuYSZKf3pWTgQ, audit_chain_id=['zrLGQXXjTNuYSZKf3pWTgQ']) at 0x7fe8a1330040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.003265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.003544 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.003872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.004814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:15.005159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.006607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25433a8b-0733-47e7-a32f-627a491cd019 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.019971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 350/702] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:15.021318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aec72-91ac-4633-94ad-3d8801fd2d40 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.021652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aec72-91ac-4633-94ad-3d8801fd2d40 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.021940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59aec72-91ac-4633-94ad-3d8801fd2d40 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.023440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 351/703] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:15.032154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.032340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.032340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.032340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.032676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.048969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:15.050152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:15.138546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 353/704] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:15.139679 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.153005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 352/705] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:41:15.153005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.278202 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158f41b-4346-41be-9e44-bd130bbcee6c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.279190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab523390-a6cb-4409-a7fc-02c0543dd213 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.323394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a1457e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.325385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.325670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.325944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.328387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zrLGQXXjTNuYSZKf3pWTgQ, audit_chain_id=['zrLGQXXjTNuYSZKf3pWTgQ']) at 0x7fe8a14ce8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.329407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.329910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.330377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.331296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.333199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.336867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.338340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:15.362061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:15.363090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:15.364820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:15.364820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:15.364820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:15.364820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:15.367898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 353/706] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:15.368753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.369515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 354/707] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:41:15 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:15.370912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.543043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec076d-7bca-451d-9881-2c74273dddca None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.554890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450577d-b6b4-4c97-a02b-c972bc93b5ca None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.606665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a1549460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.607842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.608325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.608795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.622580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:15.623252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.624891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.654170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 355/708] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:15.660353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.663955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tD1ivdWDSaa6jrUm76KHig, audit_chain_id=['tD1ivdWDSaa6jrUm76KHig']) at 0x7fe8a133c430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.664789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.665099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.665376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.666041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.668736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:15.696461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:15.697530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:15.698895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 354/709] 10.222.0.49 () {56 vars in 1129 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:15.704542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.800521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9ffa40-bb3e-447e-b4e3-baf784599f51 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.842002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a11c0f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.843123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.843566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.843884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.844046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bb4c-bfc2-4b8e-948a-6ad08031cfb5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:15.852165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.853737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:15.869895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:15.872736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:15.874929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 356/710] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:15.881016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:15.891168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tD1ivdWDSaa6jrUm76KHig, audit_chain_id=['tD1ivdWDSaa6jrUm76KHig']) at 0x7fe8a132dc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:15.891858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:15.892138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:15.892410 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:15.893169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:15.893478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:15.894875 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:15.899954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 355/711] 10.222.0.49 () {56 vars in 1124 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:15.906190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:16.018604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823a2e6-c6ad-486f-af62-0ef0a402fc86 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:16.036912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec481d7a-5558-4dba-b460-3154a0ebd93a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:16.057010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a14e0ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:16.058237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.059228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.059520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.060321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:16.060635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:16.062121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:16.076648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 357/712] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:16.082771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:16.084101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tD1ivdWDSaa6jrUm76KHig, audit_chain_id=['tD1ivdWDSaa6jrUm76KHig']) at 0x7fe8a13db6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:16.084793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.085100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.085378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.086333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:16.087570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:16.089623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bac29dc-79c8-4c47-a9e7-23735b747046 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:16.105098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 356/713] 10.222.0.49 () {56 vars in 1124 bytes} [Fri May 13 12:41:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:16.237422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e88e7b-c07e-484d-b27e-7326bd2bb4a3 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:16.294904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9j6tls8QDqktvkmBwCvoA, audit_chain_id=['H9j6tls8QDqktvkmBwCvoA']) at 0x7fe8a123a0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:16.295995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.296474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.296956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.298041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=97df92a4d0e543f79e611b9bfd03e1c3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:16.298575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:16.300250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef6708a-111f-4ec4-b904-9178424f1eee None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:16.309665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 358/714] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:16 2022] GET /identity/v3/role_assignments?user.id=97df92a4d0e543f79e611b9bfd03e1c3&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:16.368203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c7917-2be9-4c14-97d7-fac98f902f8d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.369243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c7917-2be9-4c14-97d7-fac98f902f8d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.369722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c7917-2be9-4c14-97d7-fac98f902f8d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.372171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 357/715] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:16.378446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.379068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.379563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.402160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:16.403812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:16.498777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 359/716] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:16.522921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c7917-2be9-4c14-97d7-fac98f902f8d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:16.659918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c7917-2be9-4c14-97d7-fac98f902f8d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:16.711680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tyFBf7vZQ2GSt2b_-Eg3Ag, audit_chain_id=['tyFBf7vZQ2GSt2b_-Eg3Ag']) at 0x7fe8a1490700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:16.712493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.712772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.713073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] PATH_INFO: `/v3/services/network` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.714249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:16.715644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:16.728083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:16.729150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:16.731436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 358/717] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:16 2022] GET /identity/v3/services/network => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:16.736658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:16.842737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c161a1-a70f-4381-a519-1b3ca93cca1c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:16.884080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tyFBf7vZQ2GSt2b_-Eg3Ag, audit_chain_id=['tyFBf7vZQ2GSt2b_-Eg3Ag']) at 0x7fe8a14f44c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:16.884763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:16.885072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:16.885343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:16.886161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] RBAC: Adding query filter params (name=network) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:16.886711 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:16.888171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c800cee-383b-4ee0-b833-09617faa66c2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:16.893409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 360/718] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:16.899015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:17.052738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deedd954-068b-4f28-ab52-b7a128362b13 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:17.103220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tyFBf7vZQ2GSt2b_-Eg3Ag, audit_chain_id=['tyFBf7vZQ2GSt2b_-Eg3Ag']) at 0x7fe8a13309a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:17.103890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:17.104167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:17.105362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:17.106082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] RBAC: Adding query filter params (type=network) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:17.106390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:17.107759 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4769afc7-4b93-4a34-a9fe-a9f81040a04c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:17.117058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 359/719] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:16 2022] GET /identity/v3/services?type=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:17.212209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310662dd-1866-4801-83f7-3afd34e2b5fe None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:17.212573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310662dd-1866-4801-83f7-3afd34e2b5fe None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:17.212752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310662dd-1866-4801-83f7-3afd34e2b5fe None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:17.215205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 361/720] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:17.220848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:17.221179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:17.221416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:17.246791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:17.247908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:17.332868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 360/721] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:17.372665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310662dd-1866-4801-83f7-3afd34e2b5fe None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:17.488803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310662dd-1866-4801-83f7-3afd34e2b5fe None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:17.531242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14da2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:17.531961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:17.532240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:17.532512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:17.546894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:17.554388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:17.556497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:17.558552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:17.561906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 362/722] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:17.562119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:17.735719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa161c10-6522-4cab-914b-66ad450b97cf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:17.785450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14f0820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:17.786076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:17.786359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:17.786629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:17.787439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:17.787748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:17.789189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:17.805627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 361/723] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:17.812102 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:17.952735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b9a6b-4a4f-46f8-afa9-4e7fc1fce71d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:18.020125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14da0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:18.020949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:18.021261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:18.021535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:18.041446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:18.043148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:18.066280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:18.067418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:18.068968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:18.068968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:18.068968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:18.068968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:18.068968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 363/724] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:18.074884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:18.197344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f755590-7324-4e99-acff-473c4fa197eb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:18.236484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14573a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:18.237189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:18.237522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:18.237797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:18.238531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:18.238836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:18.240201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:18.257803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 362/725] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:18.263906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:18.399013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bacc9-08cb-437b-8709-69d9ffd00294 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:18.444759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a115a3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:18.445939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:18.446420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:18.446912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:18.455683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:18.457760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-0c51b990-1b4e-4345-bfef-f3cd1321a9ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:18.478591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:18.480347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:18.485760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:18.488059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 364/726] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:18.498111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:18.556848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00efb9-8a9a-4584-a147-fa4ed99b3b3c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:18.557610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00efb9-8a9a-4584-a147-fa4ed99b3b3c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:18.558108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e00efb9-8a9a-4584-a147-fa4ed99b3b3c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:18.562032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 365/727] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:18.566130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:18.566773 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:18.567255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:18.599207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:18.600741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:18.675688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 366/728] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 13 12:41:18.680204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71e194-0295-4180-bd40-fef5917d04df None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:18.735357 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:18.737308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a13e9460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:18.738041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:18.738333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:18.738609 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:18.739468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:18.740527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:18.741271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:18.765246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 363/729] 10.222.0.49 () {56 vars in 1135 bytes} [Fri May 13 12:41:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:18.771105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:18.920393 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d1977-a5bb-4c4c-91d6-467d557731b7 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:18.957485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd575777-d694-4ac4-833d-20d839bae7c8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:18.999822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a11c0f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.002825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.003407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.004224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.029487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:19.038697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:19.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:19.040532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:19.052251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 367/730] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:19.059631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d144d-2015-4c4b-9373-9402aab56e83 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a13df4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.060583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d144d-2015-4c4b-9373-9402aab56e83 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.061202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d144d-2015-4c4b-9373-9402aab56e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.061678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d144d-2015-4c4b-9373-9402aab56e83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.061990 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.172165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d144d-2015-4c4b-9373-9402aab56e83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:19.174027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d144d-2015-4c4b-9373-9402aab56e83 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:19.236699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c00d8-52c8-4e93-a7da-8d67c3f59a4d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:19.274592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a15fd220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.275273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.275725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.276532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.277754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:19.278220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:19.279751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d47fc-163b-4d74-93ac-3117d832bb23 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:19.293278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 368/731] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:19.295619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291933-9359-40ed-a322-9024098b6980 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.295913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291933-9359-40ed-a322-9024098b6980 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.296275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d291933-9359-40ed-a322-9024098b6980 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.297700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 369/732] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:19.298872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dfa85-b2af-4277-9412-2451c382ce03 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.299366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dfa85-b2af-4277-9412-2451c382ce03 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.299810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6dfa85-b2af-4277-9412-2451c382ce03 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.306013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 370/733] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:19.306013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dfa85-b2af-4277-9412-2451c382ce03 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.330571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 364/734] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 13 12:41:19.330571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ca5ca-4ca0-4c8a-b261-9bc5c82d8286 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.330571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ca5ca-4ca0-4c8a-b261-9bc5c82d8286 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.330571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ca5ca-4ca0-4c8a-b261-9bc5c82d8286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.349922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bd8ca5ca-4ca0-4c8a-b261-9bc5c82d8286 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:19.351682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bd8ca5ca-4ca0-4c8a-b261-9bc5c82d8286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:19.416028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6dfa85-b2af-4277-9412-2451c382ce03 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:19.430984 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 365/735] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:19.432333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.433217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.433500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.449789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:19.451016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:19.465360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a14f4df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.466160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.466468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.466793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.477505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:19.478949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:19.499100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:19.500045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:19.500950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:19.500950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:19.500950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:19.500950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:19.504790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 371/736] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:19.505703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.523342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 366/737] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:19.524274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.623286 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f618b3-3fdc-4432-8d65-bedc421c62d2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:19.626641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610647bd-27a5-4e02-85aa-b66c9bb105d7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:19.659909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14f1220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.660706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.660992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.661275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.672827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:19.674315 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:19.680131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mVEW--pHQrmyPU5avjJyoA, audit_chain_id=['mVEW--pHQrmyPU5avjJyoA']) at 0x7fe8a134eb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.681081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.681977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.683399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.684312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:19.686538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:19.693952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:19.695044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:19.695974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:19.695974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:19.695974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:19.695974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:19.695974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 372/738] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:19.696604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.717213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 367/739] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:19 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:19.719122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.830635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10b602-cd4a-4557-b9d7-2df000811ef2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:19.868610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d80a1-362e-457a-a7f5-ffad628ddcde None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:19.882583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a14dde20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.883789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.884224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.884674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.885805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:19.887149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:19.889258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:19.908440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 373/740] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:19.909665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:19.912641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a1509220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:19.915386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:19.915386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:19.915386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:19.927752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:19.936154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:19.937351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:19.938376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:19.940434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 368/741] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:19.941335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.044587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3236b2-04c1-41b5-8c36-61d2c4dabb4b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.072843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9ddc45-92ae-4ecf-b6f5-43b85995207c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.084515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14daa60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.085233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.085583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.085924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.087102 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:20.087484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.089279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.107641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 374/742] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:20.107641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.119652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a138f070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.121262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.121602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.121939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.130187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.131629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b68685ec-9a3b-4878-a070-c9a3bc7996e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:20.147237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:20.148333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:20.149338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:20.153148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 369/743] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:41:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:20.154712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12284936-4b74-4b67-b506-ececbf398cba None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.155073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12284936-4b74-4b67-b506-ececbf398cba None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.155418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12284936-4b74-4b67-b506-ececbf398cba None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.157439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 370/744] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:20.161882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12284936-4b74-4b67-b506-ececbf398cba None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.226550 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296aea3-4348-465a-b200-736b91f2bead None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.262707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a14a7130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.263385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.263667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.263972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.264708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:20.265039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.266425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.269765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12284936-4b74-4b67-b506-ececbf398cba None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.280760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 375/745] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:20.281739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.306566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a13bf640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.309100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.309100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.309100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.316213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.317703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-86891599-c5c9-4d7f-b51f-47230faab0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:20.333592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:20.334629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 371/746] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.342058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.342687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.356102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:20.357584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:20.425982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594be2c4-bc1f-4738-bb2e-f5f17b88969d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.438782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 372/747] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:20 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 13 12:41:20.439461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.477487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a14ee9a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.478158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.478432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.478705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.479620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:20.479926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.481522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.505585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 376/748] 10.222.0.49 () {56 vars in 1149 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:20.505585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.552871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bddee-e9b9-4eda-8502-bf8d2e3aa725 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.594248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a13dfdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.595026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.595338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.595638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.607278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.608863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.610494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e05077-e718-43b3-91a0-788316d557f9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:20.628719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:20.629746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:20.630652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:20.630652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:20.630652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:20.630652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:20.630652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 373/749] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:20.632353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.648678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14ea3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.649373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.649654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.649923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.650707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:20.651015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.652676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.665112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 377/750] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:20.665960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.829623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb72c61-9afb-4fcc-ab6d-d7d696324e52 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.872420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927777f0-7404-4eef-a5fd-8a56c7e7c829 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:20.879539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a1499f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.880198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.880482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.880759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.916720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=waqiCBLKRL605IhmhUvOUQ, audit_chain_id=['waqiCBLKRL605IhmhUvOUQ']) at 0x7fe8a134eb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:20.918506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:20.918506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:20.918786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:20.919792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.921330 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:20.945023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 374/751] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:20 2022] POST /identity/v3/services => generated 240 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:20.945023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:20.963204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:20.970068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.091602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc9c23-ff7b-48e3-93b3-2f52bd9ee674 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.133092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 378/752] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 13 12:41:21.133092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.140025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a12ed970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.141056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.141514 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.142843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.142843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:21.142843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.144179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.160422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 375/753] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:21.161072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.274633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e246e9d-ab1e-427f-88eb-05f40c789dab None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.284086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcf30b-44e3-479a-af3a-c27f3c232fa2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.319971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tb6c5lAnQ3-ougWAK3JY9w, audit_chain_id=['tb6c5lAnQ3-ougWAK3JY9w']) at 0x7fe8a14b1c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.320627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.320903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.321208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.321325 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a1330fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.322038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=7f48f833629541c2bbc718c2372e1c1b) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:21.322343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.322752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.323653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.323847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.324403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.330892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 379/754] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/role_assignments?user.id=7f48f833629541c2bbc718c2372e1c1b&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:21.331744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.342079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.344326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:21.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:21.383589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:21.384586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:21.384586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:21.384586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:21.384586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:21.385278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 376/755] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:21.402793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.534385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0cfd8-4905-4dec-b7ac-5395b3a6b8c9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.598593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a15fd7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.599391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.599673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.599951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.602643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12f80-b464-4707-a83e-4c896361108a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.622233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.623665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.644364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a1338550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.645403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.645906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.646376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.647292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:21.647790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.649390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:21.657451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:21.658424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:21.659966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 380/756] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:21.665026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.666345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 377/757] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:21.672628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.835068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee4bb4-942f-4ef4-bc29-a0c3169e338a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.863242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379f5f5-d475-4c27-8e62-18ee1f5ac21e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:21.873833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a15315b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.874659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.874945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.875216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.876195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:21.876509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.877972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.897529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 381/758] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:21.904019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:21.936848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a1338bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:21.937703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:21.938038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:21.938306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:21.945570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:21.947009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:21.961219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:21.962195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:21.963147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:21.967673 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 378/759] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:21.971570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.083172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f051e-e88a-4d95-a741-f233c8ddd7ae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.094310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c72dc8-f54b-4ec5-b1ca-90f96abe5d00 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.119030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a13dfa60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.119692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.120507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.120755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.121569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:22.121876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.123304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.130309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a153fb50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.131100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.131380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.131653 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.141163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 379/760] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:22.142496 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.143579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.143958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:22.162895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:22.163811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:22.164681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:22.164681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:22.164681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:22.164681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:22.164681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 382/761] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:22.170413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.262156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57759c8-9295-4a80-8534-960e75e0b931 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.289871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5dac2-1bf3-4de0-8c0b-78f37b48b224 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.299633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MMltid-1TjOVJMz6I2Rcyw, audit_chain_id=['MMltid-1TjOVJMz6I2Rcyw']) at 0x7fe8a138fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.300290 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.300547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.300828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.301744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=2efb260599b1451dba561f50c3f895e0) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:22.302051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.303527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.309877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 380/762] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:22 2022] GET /identity/v3/role_assignments?user.id=2efb260599b1451dba561f50c3f895e0&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:22.343064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a15288e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.343742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.343992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.344273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.345026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:22.345315 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.346697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04fb7d-1703-490b-8c70-f20841cfd7ca None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.367055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 383/763] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:22.372635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.382189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ad80-c1c0-4c84-84b6-8a4a62f1b79f None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.382189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ad80-c1c0-4c84-84b6-8a4a62f1b79f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.382189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7ad80-c1c0-4c84-84b6-8a4a62f1b79f None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.383098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 384/764] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:22.390224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.390849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.391341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.434585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:22.435785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:22.502573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7a6b-d9fb-40f0-a46c-04bf85b34c8b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.543607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a13df820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.544805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.545312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.545803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.554201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.556465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:22.572657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:22.574563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:22.575594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:22.577969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 381/765] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:22.584352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.603341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 385/766] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:22.653210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.733054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f04f2c-cde8-4b54-86e6-49d545619b8a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.795126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a12ed610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.795803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.796083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.796358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.797179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:22.798395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.800115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.825102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 382/767] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:22.830191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.832197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d63ba-fb5a-4486-963d-25f496764a12 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:22.873230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eqNxyvbvTTy6RCKq0UCmkw, audit_chain_id=['eqNxyvbvTTy6RCKq0UCmkw']) at 0x7fe8a11c0250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:22.874574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:22.874860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:22.875135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:22.875804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:22.877390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:22.895377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:22.896387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:22.897261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 386/768] 10.222.0.49 () {56 vars in 1129 bytes} [Fri May 13 12:41:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:22.905986 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:22.999501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a4b30d-e6ea-497c-b420-f56b4e3220a7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:23.077452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=huywErzIQ8epeDtnZ3jVKQ, audit_chain_id=['huywErzIQ8epeDtnZ3jVKQ']) at 0x7fe8a12ed460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:23.078348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.078626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.078904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/97df92a4d0e543f79e611b9bfd03e1c3/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.082396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=97df92a4d0e543f79e611b9bfd03e1c3, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:23.083851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:23.107898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e84b39-a766-4675-89a6-b54c96bfb031 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:23.111906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 383/769] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:22 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/97df92a4d0e543f79e611b9bfd03e1c3/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:41:23.147412 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eqNxyvbvTTy6RCKq0UCmkw, audit_chain_id=['eqNxyvbvTTy6RCKq0UCmkw']) at 0x7fe8a1517df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:23.148237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.148422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.148702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.149467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:23.149776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:23.151153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:23.158022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 387/770] 10.222.0.49 () {56 vars in 1124 bytes} [Fri May 13 12:41:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:23.163382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:23.338496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d883839-ecdb-49c6-bb0b-e94140fc9681 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:23.382933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eqNxyvbvTTy6RCKq0UCmkw, audit_chain_id=['eqNxyvbvTTy6RCKq0UCmkw']) at 0x7fe8a142e190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:23.383611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.383888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.384155 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.384865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:23.385225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:23.387447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:23.395139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 384/771] 10.222.0.49 () {56 vars in 1124 bytes} [Fri May 13 12:41:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:23.400574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:23.562825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a796353-bc7a-4c24-87bf-0c85601ec3b1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:23.614816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eqNxyvbvTTy6RCKq0UCmkw, audit_chain_id=['eqNxyvbvTTy6RCKq0UCmkw']) at 0x7fe8a15172e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:23.615719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.616166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.616727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.618127 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] RBAC: Adding query filter params (interface=public, service_id=76ecd5d33807402aa4c469097740d654, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:23.618705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:23.621458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ab07-ac67-453a-ac03-3c4cd03ae0b2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:23.639069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 388/772] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:23 2022] GET /identity/v3/endpoints?service_id=76ecd5d33807402aa4c469097740d654&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:23.645025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:23.663667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad641d1-8153-4df2-a636-5064f390bf38 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.664002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad641d1-8153-4df2-a636-5064f390bf38 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.664222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad641d1-8153-4df2-a636-5064f390bf38 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.665846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 389/773] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:23.671908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.672192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.672472 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.712523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:23.715426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:23.872118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441d1a-87b6-4ba2-8787-86970d98408c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:23.876966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 390/774] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:23.929120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:23.949041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eqNxyvbvTTy6RCKq0UCmkw, audit_chain_id=['eqNxyvbvTTy6RCKq0UCmkw']) at 0x7fe8a13e8880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:23.950469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:23.951034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:23.951456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:23.952490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:23.954340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:23.965950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 385/775] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:23 2022] GET /identity/v3/services => generated 772 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:24.057927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40773410-94e3-4332-ab4c-9d17c7c8d14a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:24.100691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XoBeP9IBRdad01pCm5JJXw, audit_chain_id=['XoBeP9IBRdad01pCm5JJXw']) at 0x7fe8a123a220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:24.101546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.101830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.102104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] PATH_INFO: `/v3/services/network` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.102774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:24.104254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:24.122703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:24.123799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:24.124626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 391/776] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:23 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:24.130340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:24.262312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28794867-09c8-4978-ad00-9aaa0808af8e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:24.301547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XoBeP9IBRdad01pCm5JJXw, audit_chain_id=['XoBeP9IBRdad01pCm5JJXw']) at 0x7fe8a1330bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:24.302233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.302559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.302836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.303647 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] RBAC: Adding query filter params (name=network) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:24.303955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:24.305361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e11637-93fd-48cf-bb2b-ffb859be6200 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:24.317144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 386/777] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:24.318552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:24.433206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0bbd3-ccf2-4eb0-af80-2a813b92425c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.433545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0bbd3-ccf2-4eb0-af80-2a813b92425c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.433754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0bbd3-ccf2-4eb0-af80-2a813b92425c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.435284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 387/778] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:24.442009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.442653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.443173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.464171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:24.466271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:24.467242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb03cdf-3871-41bc-97dd-234e796af241 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:24.503604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XoBeP9IBRdad01pCm5JJXw, audit_chain_id=['XoBeP9IBRdad01pCm5JJXw']) at 0x7fe8a1524490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:24.504282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.504719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.505107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.506058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] RBAC: Adding query filter params (type=network) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:24.506227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:24.507522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:24.519895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 392/779] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:24.522784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:24.589158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 388/780] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:24.615130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:24.746050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a029e16e-93e2-4816-8aba-2a977e9ec5f3 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:24.785559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a1338bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:24.787512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.788126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.788745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.802674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:24.809149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e261b-3d41-43a4-964e-6679d8acd069 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:24.812295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:24.813226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:24.814072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:24.822045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 389/781] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:24.830233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:24.913701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XoBeP9IBRdad01pCm5JJXw, audit_chain_id=['XoBeP9IBRdad01pCm5JJXw']) at 0x7fe8a1528ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:24.914379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:24.914688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:24.914915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:24.915976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] RBAC: Adding query filter params (interface=public, service_id=5bc91c3c3b544f78a43d1a673d8ff4be, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:24.915976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:24.918020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:24.939647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 393/782] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:24 2022] GET /identity/v3/endpoints?service_id=5bc91c3c3b544f78a43d1a673d8ff4be&interface=public®ion_id=RegionOne => generated 194 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:24.954283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:24.971610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb3e4fa-092d-45ea-a56a-4c5d0c335b59 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.014030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a13df880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.015051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.015598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.016066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.017120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:25.017641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.019226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.033823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 390/783] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:25.035577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:25.100239 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684edc05-ea6b-4909-af44-88a783e94070 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.137577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25215d-bda0-4315-a3b6-4c3a5c81971f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=XoBeP9IBRdad01pCm5JJXw, audit_chain_id=['XoBeP9IBRdad01pCm5JJXw']) at 0x7fe8a14eabb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.138256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25215d-bda0-4315-a3b6-4c3a5c81971f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.138544 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25215d-bda0-4315-a3b6-4c3a5c81971f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.138823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25215d-bda0-4315-a3b6-4c3a5c81971f None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.139516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25215d-bda0-4315-a3b6-4c3a5c81971f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.140896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c25215d-bda0-4315-a3b6-4c3a5c81971f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.150126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 394/784] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:24 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:25.150126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454feb65-e258-4728-b17d-f0062041243d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.150126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454feb65-e258-4728-b17d-f0062041243d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.150126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454feb65-e258-4728-b17d-f0062041243d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.150126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 395/785] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:25.156061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.156392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.156614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.181071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b8698-bed6-480d-ada3-4fd65aae69c0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.206129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:25.207541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:25.229020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a1461820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.230068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.230500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.230783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.257557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.259141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:25.299015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:25.299975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:25.300878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:25.300878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:25.300878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:25.300878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:25.308202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 391/786] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:25.309955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:25.363969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 396/787] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:25.391767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:25.465123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a316832-adfb-4a9f-81d9-314fce12f7e5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.502498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a1330610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.503575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.504244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.504722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.505681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:25.506203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.507771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.521516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 392/788] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:25.528303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:25.576584 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee25c85-902d-4a77-ac7a-39bdf21f3058 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.660447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db861-facd-4823-b7a4-a928d9cd8090 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.689814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a158d700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.690638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.690923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.691192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.702700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a13dbd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.703517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.703800 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.704076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.720140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:25.726984 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.728476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:25.734518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:25.735588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:25.736551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:25.740082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 397/789] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:25.750440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:25.757996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:25.761238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:25.763846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 393/790] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:25.769088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:25.904814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c0f92-3cd1-40f7-9545-f5bc72a46df0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.914826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aa3da2-ff33-4cfc-9244-1f813cec5c31 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:25.948208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a1604940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.949001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.949195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a149e790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:25.949370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.949548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.949705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.949958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.950228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.950390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:25.950593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.951058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:25.951362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:25.951957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b526a-4445-4865-9d6f-de3eaee0ab6b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.952770 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:25.962960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 398/791] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:25.970040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d534-f77a-47b9-872f-b20ebe1838be None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.970040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d534-f77a-47b9-872f-b20ebe1838be None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.970040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339d534-f77a-47b9-872f-b20ebe1838be None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.970040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 399/792] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:25.974576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:25.975379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:25.975873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:25.977318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 394/793] 10.222.0.49 () {56 vars in 1135 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:25.981056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.004358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:26.006128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:26.078229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 400/794] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:26.079494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.095102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bcb222-c35d-4034-930f-9959a1604443 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.157468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a1490eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.158233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.158517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.158785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.171851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.173670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.192711 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320fc4c-94db-497c-9289-e66fa42bb30e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:26.200059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:26.201355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:26.202626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:26.202626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:26.202626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:26.202626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:26.202626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 395/795] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:26.202626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.239487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a15fdac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.240503 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.240940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.241353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.252616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.254259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:26.274017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:26.275025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:26.275948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:26.275948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:26.275948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:26.275948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:26.280678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 401/796] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:26.281621 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.320965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abea72f6-e802-4eb3-a23e-ed21ff6576d3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.357762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a1490100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.358892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.359354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.359816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.371472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:26.381282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:26.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:26.383164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:26.386566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 396/797] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:26.387878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.394147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86bb66-516f-43d2-9371-b3d82dcf380d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.431393 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a15825e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.432050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.432403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.432642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.433559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:26.433774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.435202 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.448406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 402/798] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:26.449318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.502916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a96365-7ae6-46c4-bd0b-471da2045d23 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.543870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a138fc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.544946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.545468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.545948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.546875 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:26.547373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.548939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.558963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825f8f3-d9c4-4820-8e7a-c3ea76e2f6bd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.562246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 397/799] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:26.563318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.600233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a158dc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.601043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.601330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.601607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.602358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:26.602717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.604155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.618571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 403/800] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:26.619519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.673526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbbdd3-aea4-4ff0-9e4f-6eb75d7936d4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.709620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a142e820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.710785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.711266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.711743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.720009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.721773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.729466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80436aa-3b24-4338-80f9-b886bcc09d1e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:26.737600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:26.738563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:26.739498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:26.742148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 398/801] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:26.743240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.765411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a1537910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.766255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.766540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.766815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.774316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.775809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:26.791600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:26.793185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:26.794056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:26.797128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 404/802] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:26.798109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.855083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69de683-7ea1-4e2b-bf20-6d7fa36bdf02 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.891344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a14f7a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.892472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.892971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.893329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.903724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.903900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef86d6-30f3-4bef-b86f-58237e36e99d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:26.905180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:26.924481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:26.925471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:26.931284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:26.931284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:26.931284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:26.931284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:26.931284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 399/803] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:26.931284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:26.940196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a160ee50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:26.940864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.941187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.941462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.942300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:26.942598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:26.944021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590d31b-2469-4805-81ab-5388530d49f0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:26.966477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 405/804] 10.222.0.49 () {56 vars in 1149 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:26.966477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af754b-f6d3-4610-9c63-35f6dad17fdf None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:26.966477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af754b-f6d3-4610-9c63-35f6dad17fdf None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:26.966477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af754b-f6d3-4610-9c63-35f6dad17fdf None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:26.968687 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 406/805] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:26.969694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af754b-f6d3-4610-9c63-35f6dad17fdf None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.061762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee63fe-7d0f-44c5-9289-195629129d31 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.097928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a150abe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.098959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.099448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.099814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.100237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af754b-f6d3-4610-9c63-35f6dad17fdf None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.100599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:27.100901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.102368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.118947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 400/806] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:27.119854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.134197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a1524fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.134867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.135144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.135422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.136688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:27.137278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.138653 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46cf8-367c-4d72-b945-04a27e499e26 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.154592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 407/807] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:27.155868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.156153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.156426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.173677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:27.174867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:27.231156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706c9c6-b578-4cb2-bb95-51f1360ac85f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.253270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 408/808] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:27.254384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.283741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a138f2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.284533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.284813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.285121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.297096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.298546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:27.316871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:27.318056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:27.318954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:27.318954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:27.318954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:27.318954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:27.318954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 401/809] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:27.319238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.365635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03177f-17db-4483-8c24-23d10a312a80 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.402992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ATLt1bD_SKuNwxYyt_BBTg, audit_chain_id=['ATLt1bD_SKuNwxYyt_BBTg']) at 0x7fe8a14d15e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.404055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.404337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.404604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/7f48f833629541c2bbc718c2372e1c1b/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.406689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=7f48f833629541c2bbc718c2372e1c1b, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.408353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.422518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 409/810] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:27 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/7f48f833629541c2bbc718c2372e1c1b/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:41:27.423661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.441230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4509353-68fa-46c2-b56e-6daabf531fc3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.489110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a13fcca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.490170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.490456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.490731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.502383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.504869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:27.525509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:27.527402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:27.528781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:27.531580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 402/811] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:27.532838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.555359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19088421-8a5c-457a-889b-3b1dacafa469 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.611660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P7r7fZC8SZa30hIQxU7xag, audit_chain_id=['P7r7fZC8SZa30hIQxU7xag']) at 0x7fe8a1529ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.612634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.612921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.613221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.613923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.615336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:27.632789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:27.634006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 13 12:41:27.634882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:27.640778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 410/812] 10.222.0.49 () {56 vars in 1129 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:27.641171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.678751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0fc4b-f5e6-40a7-8e08-e956709c45c7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.715277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a1509640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.715957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.716275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.716560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.717324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:27.717629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.718993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.732723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 403/813] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:27.733626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.789767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925a8f8-3201-471c-a9ab-b49931348635 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.825105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a1586f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.825879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.826295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.826581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.827547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:27.828088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.830318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ef3dd-7a9e-4b09-a08d-1951b6d7f14a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.865777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5857ad-f4c7-45ac-9837-b36dde00ec23 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:27.872923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 411/814] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:27.872923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53064d42-5444-4531-a4d2-004d48a55270 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.872923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53064d42-5444-4531-a4d2-004d48a55270 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.872923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53064d42-5444-4531-a4d2-004d48a55270 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.872923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 412/815] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:27.872923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53064d42-5444-4531-a4d2-004d48a55270 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:27.921701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P7r7fZC8SZa30hIQxU7xag, audit_chain_id=['P7r7fZC8SZa30hIQxU7xag']) at 0x7fe8a1434100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:27.922615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:27.923585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:27.923585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:27.924304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:27.924605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:27.925985 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:27.935699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 404/816] 10.222.0.49 () {56 vars in 1124 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:27.935699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.002965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53064d42-5444-4531-a4d2-004d48a55270 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.036927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a15288e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.037748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.038032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.038302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.045647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.047030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.059032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13609121-6c78-4a09-a04a-9ef39627ca4f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-c10ca027-93a3-4d71-bcde-a7cea0c00b35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:28.060702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:28.061848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:28.062883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 413/817] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:28.063378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.063662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.063936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.079965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:28.081183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:28.100807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a13e8f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.102153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.102855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.103271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.153775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 414/818] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:28.154671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.187857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.189432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.274802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d38028-b4dd-40dc-9c50-3240d183e21b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.293060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 405/819] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:41:28.293960 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.314366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P7r7fZC8SZa30hIQxU7xag, audit_chain_id=['P7r7fZC8SZa30hIQxU7xag']) at 0x7fe8a1581b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.314960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.315236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.315508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.316219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:28.316521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.317918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.328251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 415/820] 10.222.0.49 () {56 vars in 1124 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:28.328251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.403223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4daa2a9-7d96-46e6-8597-7347748ef2bc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.427516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402e180-5ad0-4710-8860-743958edd8f0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.438483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a13fcd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.439142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.439424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.439695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.440469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:28.440775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.442228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.453525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 406/821] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:28.454310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.466740 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kE286kivTaGRLLedyhuiEg, audit_chain_id=['kE286kivTaGRLLedyhuiEg']) at 0x7fe8a14ce040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.467817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.468198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.468567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.469403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.470846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:28.483225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:28.484420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 13 12:41:28.485467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:28.491113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 416/822] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:28.491113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.561926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7f3e7-fd1f-49a3-898e-c90a41107c90 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.591433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e0349-948a-4d61-a3b5-f49d278f06c2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.594711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a1338d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.595498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.595773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.596040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.607605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.609232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.626785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=P7r7fZC8SZa30hIQxU7xag, audit_chain_id=['P7r7fZC8SZa30hIQxU7xag']) at 0x7fe8a15dfa60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:28.627355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:28.628237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:28.629167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:28.629167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:28.629167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:28.629167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:28.629167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 407/823] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:28.629458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.634623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.634623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.634623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.634623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.634623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.665284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 417/824] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:28.665284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.765748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d62d9b-226e-42f5-88d7-00e145b46848 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.793953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954bfbc-ec0c-4c39-b7fe-2190062f7c6b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.803823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QW8t6SZaSDC0VO8EJS2E4Q, audit_chain_id=['QW8t6SZaSDC0VO8EJS2E4Q']) at 0x7fe8a1505d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.805066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.805454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.805830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/2efb260599b1451dba561f50c3f895e0/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.822636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=2efb260599b1451dba561f50c3f895e0, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.824502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.832605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kE286kivTaGRLLedyhuiEg, audit_chain_id=['kE286kivTaGRLLedyhuiEg']) at 0x7fe8a1579eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:28.833372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:28.833659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:28.834017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:28.834813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] RBAC: Adding query filter params (name=network) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:28.835173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:28.836729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:28.845324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 408/825] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:28 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/2efb260599b1451dba561f50c3f895e0/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:41:28.846357 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.848233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 418/826] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:28.849710 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:28.980212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a690911-1852-4262-8524-4beea8153ae0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:28.996945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db90ac-0749-4353-a023-c9ddc015e045 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:29.030368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kE286kivTaGRLLedyhuiEg, audit_chain_id=['kE286kivTaGRLLedyhuiEg']) at 0x7fe8a14dd5b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:29.031746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:29.032258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:29.032743 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:29.034246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] RBAC: Adding query filter params (type=network) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:29.035066 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:29.036735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:29.038796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a134e280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:29.039498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:29.040056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:29.040056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:29.040757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:29.041098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:29.042567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:29.045147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 419/827] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:29.054065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:29.062303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 409/828] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:29.068121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:29.173545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3493863-4b14-4d73-b418-5c546db040eb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:29.186522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827f67-4a24-4762-818f-333f02b92053 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:29.210987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kE286kivTaGRLLedyhuiEg, audit_chain_id=['kE286kivTaGRLLedyhuiEg']) at 0x7fe8a15ffd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:29.211650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:29.211931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:29.212205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:29.212948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:29.215161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:29.230273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a134e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:29.231301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:29.231587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:29.231864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:29.248548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:29.251696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:29.254512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 420/829] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:29.279474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:29.280431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:29.281375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 410/830] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:29.288338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:29.452040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15b8ac6-f6a0-442e-9911-7740f7c59551 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:29.488733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a1524e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:29.489423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:29.489699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:29.489967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:29.490758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:29.491063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:29.492481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb288636-9df2-46ad-80bb-2bc7982e1c06 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:29.505413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 421/831] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:29.511226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:29.638367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec14da-0f6d-4c08-99bf-33fdf6b7d0eb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:29.682109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Nt3EB_2cQkyw_OEerFkZbQ, audit_chain_id=['Nt3EB_2cQkyw_OEerFkZbQ']) at 0x7fe8a14904f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:29.682876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:29.683330 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:29.683624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:29.684462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=97df92a4d0e543f79e611b9bfd03e1c3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:29.684774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:29.686269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb96d-d832-4e39-8997-44df304e4c29 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:29.693090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 411/832] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:29 2022] GET /identity/v3/role_assignments?user.id=97df92a4d0e543f79e611b9bfd03e1c3&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:30.002881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6543-5847-4d5a-8eab-76e3e330b331 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.003205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6543-5847-4d5a-8eab-76e3e330b331 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.003445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9c6543-5847-4d5a-8eab-76e3e330b331 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.005014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 422/833] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:30.011045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.011588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.012341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.030670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:30.032218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:30.109103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 412/834] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:30.127555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c6543-5847-4d5a-8eab-76e3e330b331 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:30.233326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9c6543-5847-4d5a-8eab-76e3e330b331 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:30.268779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a1537760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:30.269970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.270465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.270934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.282307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:30.290115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:30.291042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:41:30.292003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:30.299213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 423/835] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:30.300804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:30.402106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bcd0a4-26a8-4cf7-9639-b5b9582b52ff None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:30.436924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a13e9f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:30.437997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.438479 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.438963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.439901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:30.440423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:30.442014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:30.455351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 413/836] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:30.456967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:30.560252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798032b-f3d9-40fe-a6f1-9c7817ce6c6b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:30.595271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a15812e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:30.596501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.597021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.597517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.608674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:30.610460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:30.627659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:30.628528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:30.629475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:30.629475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:30.629475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:30.629475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:30.631660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 424/837] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:30.638032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:30.741783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058abc-8b8f-4ea1-af1d-78df43a8e2a9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:30.776417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a14badf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:30.777148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.777444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.777714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.778437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:30.778742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:30.780111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:30.797210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 414/838] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:30.798575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:30.906642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2623b5-116d-4da6-abe4-324d44c359e7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:30.942521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a1528040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:30.943683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:30.944165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:30.944636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:30.952533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:30.954285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:30.975023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:30.976060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:30.977643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 425/839] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:41:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:30.985684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.095686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684bed0-b03a-4215-b2ff-8bed40c10c7c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.130142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a1501ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.130823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.131104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.131380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.132215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:31.132525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:31.133981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab5028-b889-40d2-bb81-e917f6fd86fc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:31.157355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 415/840] 10.222.0.49 () {56 vars in 1135 bytes} [Fri May 13 12:41:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:31.158830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.227363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3f3eb-e1ee-4a8c-888c-3cc42bb92eae None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.227689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3f3eb-e1ee-4a8c-888c-3cc42bb92eae None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.227923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce3f3eb-e1ee-4a8c-888c-3cc42bb92eae None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.230083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 416/841] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:31.238533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.239337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.239853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.260533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:31.262953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:31.275784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe8a82-4f02-4637-9bcb-c28071081547 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.318028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108016-9263-46aa-b644-1504089f086f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a14daa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.319027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108016-9263-46aa-b644-1504089f086f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.319562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108016-9263-46aa-b644-1504089f086f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.319849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59108016-9263-46aa-b644-1504089f086f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.348794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 417/842] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:31.373420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.413914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59108016-9263-46aa-b644-1504089f086f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:31.415929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59108016-9263-46aa-b644-1504089f086f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:31.494824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed908a-f53c-4ab9-a41c-71a2901af3fe None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.530409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UuQmVFr3SP-OXJtP1Dr9fw, audit_chain_id=['UuQmVFr3SP-OXJtP1Dr9fw']) at 0x7fe8a13e9b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.531562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.532043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.532515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.533450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:31.535024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:31.542947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 426/843] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:41:31.547046 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108016-9263-46aa-b644-1504089f086f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-08c048ec-d634-4a54-a44d-e60b821d2724 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:31.548532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:31.549547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:31.550389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 418/844] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:31.551914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bc0c-5a10-43c5-a268-3be1fd13d27c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.551914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bc0c-5a10-43c5-a268-3be1fd13d27c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.551914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843bc0c-5a10-43c5-a268-3be1fd13d27c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.553206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 419/845] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:31.558736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.559011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.559281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.575888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:31.577094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:31.642426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 420/846] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:31.644064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.666783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59108016-9263-46aa-b644-1504089f086f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.703580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a1586f70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.704440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.704727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.705021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.715894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:31.717370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:31.735447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:31.746217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:31.748106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:31.748106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:31.748106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:31.748106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:31.748106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 427/847] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:31.748106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.764110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f88cc-0bfe-410e-8b53-d5a2f3a2fc4c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.800595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UuQmVFr3SP-OXJtP1Dr9fw, audit_chain_id=['UuQmVFr3SP-OXJtP1Dr9fw']) at 0x7fe8a149eb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.801561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.801910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.802448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.802908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:31.803224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:31.804692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:31.810146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 421/848] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:31.815528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.847830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2b75c0-a896-488d-a322-8f5fd4aa5cb9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.881821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a15736d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.882616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.882900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.883170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.894863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:31.903054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:31.903967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:31.904897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 428/849] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:31.905671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:31.919500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38277be9-25dd-4f0e-882c-e1fb77963d59 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:31.952901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a133cd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:31.953593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:31.953925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:31.954143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:31.954856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:31.955161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:31.956517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:31.972641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 422/850] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:31.973134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.012694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7d7ff7-df73-4bd1-b5b3-a0d14f3043e7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.045383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UuQmVFr3SP-OXJtP1Dr9fw, audit_chain_id=['UuQmVFr3SP-OXJtP1Dr9fw']) at 0x7fe8a160c730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.046034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.046311 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.046579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.047274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:32.047571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.048919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.053365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 429/851] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:32.054018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.077123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e35f1e-91cd-4bce-aea8-b4b034951eaf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.127613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a14f7760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.128357 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.128687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.129023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.129777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:32.130081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.131480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8f679-08c5-477c-a1bc-b480ef7022d7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.145419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 423/852] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:41:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:32.146698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627f0b-3543-40dd-a6c7-cbc921855c5b None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.146986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627f0b-3543-40dd-a6c7-cbc921855c5b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.147260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4627f0b-3543-40dd-a6c7-cbc921855c5b None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.148876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 424/853] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:32.149582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4627f0b-3543-40dd-a6c7-cbc921855c5b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.181701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a4305-cf18-4632-8061-0e998784e0f1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.222335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a1570c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.223147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.223430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.223705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.232489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.233998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-693ff0dd-8945-42fd-86c2-3ca8bc690cc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:32.249580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:32.250519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:32.251381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 430/854] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:32.252399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.252583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.252853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.269705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4627f0b-3543-40dd-a6c7-cbc921855c5b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.270078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:32.271253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:32.305224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a14fa0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.306150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.306426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.306806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.318522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.319942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:32.337277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:32.338392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:32.339402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:32.339402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:32.339402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:32.339402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:32.339402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 425/855] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:32.339828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.345306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 431/856] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:32.345794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.447050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd54a6-b162-4a88-9e5a-96a7a5d2f07d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.451726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11128dc-0445-41df-b01d-993bb278a785 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.483074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a14e4850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.483736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.484017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.484288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.485093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:32.485400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.486486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a1524fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.486830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.487139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.487415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.487680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.488392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:32.488692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.490070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.503807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 426/857] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:32.503807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.511491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 432/858] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:32.511491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.606115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e78d08-8a3a-44e3-a5f6-ca7451d4992c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.611400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce52ce-20f4-4863-b8b7-50da74877b5f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.641406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GGE9ASKmQde9cYFjzpFfgQ, audit_chain_id=['GGE9ASKmQde9cYFjzpFfgQ']) at 0x7fe8a149ecd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.642221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.642503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.643043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.643408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.644828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.645169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3vU3xz8bQN6w20JSvjh0MQ, audit_chain_id=['3vU3xz8bQN6w20JSvjh0MQ']) at 0x7fe8a160a730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.645922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.646208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.646486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.647298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=7f48f833629541c2bbc718c2372e1c1b) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:32.647604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.649025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.654789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 433/859] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/role_assignments?user.id=7f48f833629541c2bbc718c2372e1c1b&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:32.655559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:32.657709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:32.658703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:32.659543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:32.663990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 427/860] 10.222.0.49 () {56 vars in 1132 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:32.664976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.777459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d40eb6-6169-45cd-bf99-c9d691145f10 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.792526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a336b0-2788-4347-ba24-4c188dc34d35 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.816095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a158d4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.817387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.817848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.818295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.827331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.829148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.835550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GGE9ASKmQde9cYFjzpFfgQ, audit_chain_id=['GGE9ASKmQde9cYFjzpFfgQ']) at 0x7fe8a1507070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:32.836236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:32.836518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:32.836814 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:32.837861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:32.838171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:32.840274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:32.845638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 428/861] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:32.848050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:32.849158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:32.850123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:32.851206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.853085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 434/862] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:32.865034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:32.976850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477230a4-278e-4abe-b67f-2d9f69c08f8d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:32.977373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab35048-587c-4f40-80df-0f7600690491 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:33.013296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a1581fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:33.014105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:33.014486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:33.014883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:33.015817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:33.016220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:33.017782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:33.025971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GGE9ASKmQde9cYFjzpFfgQ, audit_chain_id=['GGE9ASKmQde9cYFjzpFfgQ']) at 0x7fe8a1568790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:33.027346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:33.027856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:33.029169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:33.030080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:33.030532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:33.032054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:33.037274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 435/863] 10.222.0.49 () {56 vars in 1149 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:33.038093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 429/864] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:32 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:33.043461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:33.155373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f0229-c813-413c-be00-725b1fa445aa None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:33.194055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a15dfc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:33.194721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:33.195004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:33.195278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:33.268324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:33.269804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:33.378469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 436/865] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:41:33.383977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:33.491490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fccf0a-3161-4164-b46f-9d21f549a749 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:33.526193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a149e3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:33.527713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:33.528170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:33.528603 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:33.540565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:33.542354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:33.559946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:33.561087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:33.562213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:33.562213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:33.562213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:33.562213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:33.568256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 430/866] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:33.569886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:33.671394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc898f-31d2-447d-bafa-47d9e7fe0225 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:33.707139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a158d850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:33.707963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:33.708344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:33.708717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:33.709581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:33.710007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:33.711480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:33.723635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 437/867] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:33.729087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:33.841572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe3d0c-fe60-4683-a4a1-f8677bd08b72 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:33.876250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a14e1220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:33.877321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:33.877769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:33.878187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:33.885465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:33.888000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:33.908653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:33.909790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:33.910880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:33.917694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 431/868] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:33.920278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:34.025098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb80f5-87d5-4fe2-80c6-dd5d4a7503b8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:34.059113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a1582640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:34.060096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:34.060554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:34.061042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:34.061940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:34.062268 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:34.063710 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60057ca1-4cf7-4bd1-8850-4ba09db5a00c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:34.077396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 438/869] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:34.083104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:34.185334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58c8d9-c68f-45da-af4d-756db303029b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:34.222850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7x-CwARbSqiMNr2h8ZBoLQ, audit_chain_id=['7x-CwARbSqiMNr2h8ZBoLQ']) at 0x7fe8a14e8dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:34.223880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:34.224358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:34.224848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:34.225992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=2efb260599b1451dba561f50c3f895e0) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:34.226539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:34.228286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70383eb-7f27-41fb-8626-58e8506c4e2e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:34.241110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 432/870] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:34 2022] GET /identity/v3/role_assignments?user.id=2efb260599b1451dba561f50c3f895e0&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:34.430733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fa8f-cb72-446b-9a91-ce5e717d274e None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:34.431042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fa8f-cb72-446b-9a91-ce5e717d274e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:34.431293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5fa8f-cb72-446b-9a91-ce5e717d274e None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:34.433535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 439/871] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:34.439161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78814b9-dba5-427e-a7bc-55a394071daf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:34.439438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78814b9-dba5-427e-a7bc-55a394071daf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:34.439710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78814b9-dba5-427e-a7bc-55a394071daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:34.456679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d78814b9-dba5-427e-a7bc-55a394071daf None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:34.457879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d78814b9-dba5-427e-a7bc-55a394071daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:34.528589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 433/872] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:34.551805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fa8f-cb72-446b-9a91-ce5e717d274e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:34.662809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5fa8f-cb72-446b-9a91-ce5e717d274e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:34.703350 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cef829-246c-4195-95ef-56e08c2046b7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=HZd1mEPGRvWl1BODV0OldQ, audit_chain_id=['HZd1mEPGRvWl1BODV0OldQ']) at 0x7fe8a15f6310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:34.704760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef829-246c-4195-95ef-56e08c2046b7 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:34.705282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef829-246c-4195-95ef-56e08c2046b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:34.705744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cef829-246c-4195-95ef-56e08c2046b7 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:34.706660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef829-246c-4195-95ef-56e08c2046b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:34.708239 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cef829-246c-4195-95ef-56e08c2046b7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:34.725693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 440/873] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:34 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:35.077304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0448-c532-489f-bd19-86cf13d561b1 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.077816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0448-c532-489f-bd19-86cf13d561b1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.077816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6de0448-c532-489f-bd19-86cf13d561b1 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.079622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 434/874] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:35.085209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.085714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.086204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.105624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:35.107196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:35.187934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 441/875] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:35.210592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de0448-c532-489f-bd19-86cf13d561b1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:35.320169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6de0448-c532-489f-bd19-86cf13d561b1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:35.357145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VYRAbhBRQwmvxDjGaOen9Q, audit_chain_id=['VYRAbhBRQwmvxDjGaOen9Q']) at 0x7fe8a14f0a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:35.358336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.358821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.359291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.360147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:35.361748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-034e13bd-1f16-4e66-8d86-3b1fdd2e9d59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:35.375452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:35.376502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:35.377380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:35.380178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 435/876] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:35.386417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:35.406791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d845d-bebd-4b86-a1e3-8d49bfa24116 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.407105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d845d-bebd-4b86-a1e3-8d49bfa24116 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.407341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d845d-bebd-4b86-a1e3-8d49bfa24116 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.408695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 436/877] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:35.414222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.414496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.414765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.431702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:35.432926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:35.504594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a555bb4-d388-4f69-b3b2-d0771c7801d3 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:35.513067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 437/878] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:35.529948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:35.539795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VYRAbhBRQwmvxDjGaOen9Q, audit_chain_id=['VYRAbhBRQwmvxDjGaOen9Q']) at 0x7fe8a119a0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:35.540460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.540737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.541023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.542295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:35.542655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:35.543938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:35.553273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 442/879] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:35.554503 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:35.630676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db27b8-28a9-488d-96ed-29ba3963e7a7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:35.656092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65f7601-d8be-49f9-9350-62443976898f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:35.665981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd1741-e11f-4c9a-8fe2-8a8a46d1458a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tHi-xuXxQGSxzx7_zlK5ZQ, audit_chain_id=['tHi-xuXxQGSxzx7_zlK5ZQ']) at 0x7fe8a14684f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:35.666657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd1741-e11f-4c9a-8fe2-8a8a46d1458a None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.668027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd1741-e11f-4c9a-8fe2-8a8a46d1458a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.668027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd1741-e11f-4c9a-8fe2-8a8a46d1458a None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.668576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd1741-e11f-4c9a-8fe2-8a8a46d1458a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:35.669969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd1741-e11f-4c9a-8fe2-8a8a46d1458a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:35.688192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 438/880] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:35 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:35.706895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=VYRAbhBRQwmvxDjGaOen9Q, audit_chain_id=['VYRAbhBRQwmvxDjGaOen9Q']) at 0x7fe8a1459fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:35.713025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:35.713025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:35.713025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:35.713025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:35.713025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:35.713025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a184960-2a91-40e1-8061-d898f54228f8 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:35.716911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 443/881] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:35 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:36.627702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398c8d-96b2-4f99-98cb-0d2aff327e7a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:36.628229 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398c8d-96b2-4f99-98cb-0d2aff327e7a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:36.628229 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc398c8d-96b2-4f99-98cb-0d2aff327e7a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:36.629867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 439/882] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:36.635278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:36.635625 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:36.636748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:36.653490 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:36.654675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:36.723545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 444/883] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:36.747332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc398c8d-96b2-4f99-98cb-0d2aff327e7a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:36.848944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc398c8d-96b2-4f99-98cb-0d2aff327e7a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:36.895503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a1568be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:36.896366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:36.896650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:36.896926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:36.908309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:36.916620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:36.920161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:36.922223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 440/884] 10.222.0.49 () {56 vars in 1120 bytes} [Fri May 13 12:41:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:36.929094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.032870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a81e-9bc6-4d7b-914c-c8ae5eefd5e2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.070305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a14e0610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.070985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.071270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.071545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.072303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:37.072611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.074619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7226a-5f4c-4ec0-8319-5c531e3ddcd3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.083382 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 445/885] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:41:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:37.089593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.193464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed79c9f-7612-46c8-b462-711a0eb688c5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.222213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea56c-cf4c-4430-9506-95cbc396be0c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.222824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea56c-cf4c-4430-9506-95cbc396be0c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.223386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ea56c-cf4c-4430-9506-95cbc396be0c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.225230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 446/886] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:37.228656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a14e8a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.230152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.230740 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.230740 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.232198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.232693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.233225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.241640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.243095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.251612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:37.253069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:37.260847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:37.262462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:37.263349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:37.263349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:37.263349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:37.263349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:37.263349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 441/887] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:37.270077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.349004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 447/888] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:37.363645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.382839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e215b7-22e3-4fbc-91e6-ac2612d1c2c6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.422147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a14fa460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.423188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.423674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.424153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.425133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:37.425646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.427255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.440298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 442/889] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:37.445877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.484364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621b268-1cd3-4704-b4dd-c0103dca199d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.520332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xtVc-mvvQpu75OJle-wMgg, audit_chain_id=['xtVc-mvvQpu75OJle-wMgg']) at 0x7fe8a158da00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.521182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.521470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.522028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.522701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.525055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:37.540575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:37.541656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:37.543206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 448/890] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:37.550449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.563689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98698e66-f6b0-4e29-afcf-ddc5d0de97df None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.605818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a14e4940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.607111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.607111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.607314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.614602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.616053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:37.632604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:37.634049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:37.635411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 443/891] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:37.640468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.688502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e5161-58bc-4d41-abf7-b24a78d107fe None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.723938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xtVc-mvvQpu75OJle-wMgg, audit_chain_id=['xtVc-mvvQpu75OJle-wMgg']) at 0x7fe8a1579250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.724580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.724850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.725161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.725872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:37.726178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.727596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.738724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 449/892] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:37.739957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.766859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262668f2-05a6-4f45-8d16-f0c800724fdf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.814409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a15631c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.816024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.816728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.817244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.818327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:37.818855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.821757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.847557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 444/893] 10.222.0.49 () {56 vars in 1149 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:37.859281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.897774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c07c1-8045-49a2-9d54-b0d4ac7a85c2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:37.944277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xtVc-mvvQpu75OJle-wMgg, audit_chain_id=['xtVc-mvvQpu75OJle-wMgg']) at 0x7fe8a15791f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:37.945968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:37.946763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:37.947256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:37.948428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:37.949115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:37.951855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:37.964630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 450/894] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:37.966516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:37.999616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8025a50-9104-4734-8266-31ee5f687e3e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.034484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a19c40-3b1d-4be0-a1d0-88cd0be6a39d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a14e5d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.035130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a19c40-3b1d-4be0-a1d0-88cd0be6a39d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.035467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a19c40-3b1d-4be0-a1d0-88cd0be6a39d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.035746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a19c40-3b1d-4be0-a1d0-88cd0be6a39d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.083788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b857ae7-ae00-4712-9679-26adf2bd2e51 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.103947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a19c40-3b1d-4be0-a1d0-88cd0be6a39d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.105476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a19c40-3b1d-4be0-a1d0-88cd0be6a39d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.117894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xtVc-mvvQpu75OJle-wMgg, audit_chain_id=['xtVc-mvvQpu75OJle-wMgg']) at 0x7fe8a155ac40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.118855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.119375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.119751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.121109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] RBAC: Adding query filter params (interface=public, service_id=cf43580803be4ae2837d432468806873, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:38.121408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.122766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f71e900-0035-41d0-b002-4c66ea4fe950 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.128167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 451/895] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/endpoints?service_id=cf43580803be4ae2837d432468806873&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:38.129492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7cf1-f466-47fa-994e-d8bf4beac487 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.129776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7cf1-f466-47fa-994e-d8bf4beac487 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.130051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a7cf1-f466-47fa-994e-d8bf4beac487 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.133154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 452/896] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:38.133154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ee00-e65d-48cf-b740-970af303b5af None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.133154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ee00-e65d-48cf-b740-970af303b5af None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.133154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75ee00-e65d-48cf-b740-970af303b5af None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.137378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 453/897] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:38.138159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ee00-e65d-48cf-b740-970af303b5af None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.207493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 445/898] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:41:38.208918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.209239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.209515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.226681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:38.227877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:38.239329 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75ee00-e65d-48cf-b740-970af303b5af None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.273616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f12e2-b976-47a4-852b-db86eaf6ed59 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=xtVc-mvvQpu75OJle-wMgg, audit_chain_id=['xtVc-mvvQpu75OJle-wMgg']) at 0x7fe8a1556af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.274208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f12e2-b976-47a4-852b-db86eaf6ed59 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.274491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f12e2-b976-47a4-852b-db86eaf6ed59 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.274763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f12e2-b976-47a4-852b-db86eaf6ed59 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.275441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f12e2-b976-47a4-852b-db86eaf6ed59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.277027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f12e2-b976-47a4-852b-db86eaf6ed59 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.282526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 454/899] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/services => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:41:38.283685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.283961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.284246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.295406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 446/900] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:38.296524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.310203 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:38.311493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:38.383596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 455/901] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:38.389395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.432221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c639a91e-9f22-4596-a88d-28f697d50f7e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.470551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a187de20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.475172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.475172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.475172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.482838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.484303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:38.503727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:38.504699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:38.506006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:38.506006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:38.506006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:38.506006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:38.506006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 447/902] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:38.506006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.515018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18c832-97c3-491c-aa5a-96028f91fcbe None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.548640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=j2sUoGzNRAiD4OOkd_al5w, audit_chain_id=['j2sUoGzNRAiD4OOkd_al5w']) at 0x7fe8a14ea2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.549259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.549647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.549953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.550676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.552041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.568731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 456/903] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:38 2022] POST /identity/v3/services => generated 241 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:38.569669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.639255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a2735-8f18-40db-a4e3-efb1bd477fa5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.687794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yPfCq1ceTS2pOOFPFV8JMQ, audit_chain_id=['yPfCq1ceTS2pOOFPFV8JMQ']) at 0x7fe8a14e27c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.688920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.689377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.689798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.690662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.692151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b504cd-3da0-44fb-9bfe-22c3b7ab2623 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.692625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:38.706543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:38.707662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:38.708511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:38.716283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 448/904] 10.222.0.49 () {56 vars in 1132 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:38.717566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.736302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a14e0610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.737054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.737353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.737627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.738513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:38.738822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.740227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.755435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 457/905] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:38.760494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.841504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a56118-0f3e-4194-84ce-f2383ed29c58 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.871160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171149e7-91de-4235-8612-fdab361a3191 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:38.878145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yPfCq1ceTS2pOOFPFV8JMQ, audit_chain_id=['yPfCq1ceTS2pOOFPFV8JMQ']) at 0x7fe8a14d39d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.879071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.879571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.880051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.880965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:38.881511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.883065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.889360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 449/906] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:38.894578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:38.910651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a1c5ccd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:38.912324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:38.913059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:38.913571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:38.921575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:38.924504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:38.939446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:38.940373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:38.941689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:38.943866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 458/907] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:38.952589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:39.009948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d855320f-0950-4281-af2f-e668f26c54f5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:39.050700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yPfCq1ceTS2pOOFPFV8JMQ, audit_chain_id=['yPfCq1ceTS2pOOFPFV8JMQ']) at 0x7fe8a14f7a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:39.051666 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:39.052092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:39.052571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:39.053491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:39.053985 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:39.055524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:39.061664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 450/908] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:39.067453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:39.069893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa1ef7-e498-4309-b2eb-e0b6e829ea86 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:39.109307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a1573760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:39.110353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:39.110841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:39.111336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:39.112409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:39.113018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:39.114756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:39.128167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 459/909] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:39.134633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:39.185280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea3b8c9-3a33-4a91-8111-d4b349d67004 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:39.223917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yPfCq1ceTS2pOOFPFV8JMQ, audit_chain_id=['yPfCq1ceTS2pOOFPFV8JMQ']) at 0x7fe8a13aadc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:39.224969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:39.225541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:39.226104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:39.227079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] RBAC: Adding query filter params (interface=public, service_id=3271af5bd9cf45738944497f600d403e, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:39.227580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:39.229155 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:39.238921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 451/910] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:39 2022] GET /identity/v3/endpoints?service_id=3271af5bd9cf45738944497f600d403e&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:39.243857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:39.263845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab4ec8-ed1a-45a0-9b29-65958de99153 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:39.304438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=6mBLcY8NT-iqVQieJRwJSQ, audit_chain_id=['6mBLcY8NT-iqVQieJRwJSQ']) at 0x7fe8a25eed90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:39.305139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:39.305674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:39.305955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:39.306781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] RBAC: Adding query filter params (role.id=b4e1ef2657e740fd94ebd133a0ae3d17, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=2efb260599b1451dba561f50c3f895e0) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:39.307093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:39.309100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15b8994-113d-4180-9fac-26a9089d60d5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:39.321014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 460/911] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:39 2022] GET /identity/v3/role_assignments?user.id=2efb260599b1451dba561f50c3f895e0&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b4e1ef2657e740fd94ebd133a0ae3d17 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:39.366181 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc418e2-16e4-4d1c-bc7c-e45e781721e0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:39.403845 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e0e5-223d-4541-bfa0-08d5b1dea74c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yPfCq1ceTS2pOOFPFV8JMQ, audit_chain_id=['yPfCq1ceTS2pOOFPFV8JMQ']) at 0x7fe8a14fa460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:39.404525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e0e5-223d-4541-bfa0-08d5b1dea74c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:39.404802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e0e5-223d-4541-bfa0-08d5b1dea74c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:39.405101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e0e5-223d-4541-bfa0-08d5b1dea74c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:39.405788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e0e5-223d-4541-bfa0-08d5b1dea74c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:39.407164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e0e5-223d-4541-bfa0-08d5b1dea74c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:39.414292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 452/912] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:39 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:41:40.644093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10054835-e04d-4cb2-919b-6c70743810c2 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:40.644642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10054835-e04d-4cb2-919b-6c70743810c2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:40.644642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10054835-e04d-4cb2-919b-6c70743810c2 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:40.646275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 461/913] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:40.652473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c525c-3b2c-4d48-9d89-71089ceabbfd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:40.652905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c525c-3b2c-4d48-9d89-71089ceabbfd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:40.653114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564c525c-3b2c-4d48-9d89-71089ceabbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:40.671616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-564c525c-3b2c-4d48-9d89-71089ceabbfd None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:40.672817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-564c525c-3b2c-4d48-9d89-71089ceabbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:40.750979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 453/914] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:40.774455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10054835-e04d-4cb2-919b-6c70743810c2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:40.882737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10054835-e04d-4cb2-919b-6c70743810c2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:40.890996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b102bc-7cc7-47fc-b2de-71ab477f1bb2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:40.891555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b102bc-7cc7-47fc-b2de-71ab477f1bb2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:40.892021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b102bc-7cc7-47fc-b2de-71ab477f1bb2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:40.893847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 454/915] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:40.899261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:40.899788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:40.900258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:40.918355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:40.919850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:40.924700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7JiFkAzQpC9Y9s6Zo8VOg, audit_chain_id=['L7JiFkAzQpC9Y9s6Zo8VOg']) at 0x7fe8a158d850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:40.925590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:40.925877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:40.926153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:40.926814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:40.928186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:40.940696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:40.941750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:40.942593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 462/916] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:40.947776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.008576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 455/917] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:41.024012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.081454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983779b4-928e-4d18-972e-d18732c1521c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.126561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7987-dbec-44c1-ad0f-ae767283cbb0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.131206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7JiFkAzQpC9Y9s6Zo8VOg, audit_chain_id=['L7JiFkAzQpC9Y9s6Zo8VOg']) at 0x7fe8a1202610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.132069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.132493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.132906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.133793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:41.134698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.137462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.149797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 463/918] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:41.150784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.172831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9IY7J6FxQ0SwBAdlMcuEhQ, audit_chain_id=['9IY7J6FxQ0SwBAdlMcuEhQ']) at 0x7fe8a14c05b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.173728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.174007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.174351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.174922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.176282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:41.188704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:41.189783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:41.190616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:41.195647 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 456/919] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:41.196750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.284440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58689d-db68-4f3a-948d-1df8bbbe2dc2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.300207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423eeec-2f06-4822-b777-df03349b4543 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.329148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7JiFkAzQpC9Y9s6Zo8VOg, audit_chain_id=['L7JiFkAzQpC9Y9s6Zo8VOg']) at 0x7fe8a1549670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.330306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.331066 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.331779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.332854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:41.333452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.335065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.335914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9IY7J6FxQ0SwBAdlMcuEhQ, audit_chain_id=['9IY7J6FxQ0SwBAdlMcuEhQ']) at 0x7fe8a14dc640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.336742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.336914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.337335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.338232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:41.338475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.340545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.347751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 464/920] 10.222.0.49 () {56 vars in 1114 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:41.348306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.351219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 457/921] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:41.357804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.464063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb45ea-404e-4c81-800f-e8193e2982ba None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.487196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b723d8-36e9-47ae-bf9c-6d0d9e253eae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.508057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=L7JiFkAzQpC9Y9s6Zo8VOg, audit_chain_id=['L7JiFkAzQpC9Y9s6Zo8VOg']) at 0x7fe8a1575be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.509069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.509497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.510107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.511019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.513088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.529777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9IY7J6FxQ0SwBAdlMcuEhQ, audit_chain_id=['9IY7J6FxQ0SwBAdlMcuEhQ']) at 0x7fe8a1532d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.530797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.531199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.531594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.532461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:41.532893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.534598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdcc8b-4c22-487b-ad3c-8932ffcfed70 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.542641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 465/922] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:41:41.545769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 458/923] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:41.552524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.653239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c8dc-1053-4341-9c29-fe1869b81a6d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.653765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c8dc-1053-4341-9c29-fe1869b81a6d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.653765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1215c8dc-1053-4341-9c29-fe1869b81a6d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.655700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 459/924] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:41.669020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab0b09-c074-4a88-a9d1-0b5e104d5344 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.669020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab0b09-c074-4a88-a9d1-0b5e104d5344 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.669020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab0b09-c074-4a88-a9d1-0b5e104d5344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.709010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7cab0b09-c074-4a88-a9d1-0b5e104d5344 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:41.716032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7cab0b09-c074-4a88-a9d1-0b5e104d5344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:41.732039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e795863-f68a-460b-abd0-e40191aa4753 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.778398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9IY7J6FxQ0SwBAdlMcuEhQ, audit_chain_id=['9IY7J6FxQ0SwBAdlMcuEhQ']) at 0x7fe8a1556bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.779080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.779364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.779639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.780439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] RBAC: Adding query filter params (interface=public, service_id=5c17be3fe06a440995d04eaa24325994, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:41.780752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.782941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fd569-6746-4922-9e1d-d9309288ed58 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.790740 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 466/925] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/endpoints?service_id=5c17be3fe06a440995d04eaa24325994&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:41.792324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4af3-1df2-4b84-9aa3-72fd78dd96d6 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.792616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4af3-1df2-4b84-9aa3-72fd78dd96d6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.792887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d4af3-1df2-4b84-9aa3-72fd78dd96d6 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.794450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 467/926] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:41.798273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d4af3-1df2-4b84-9aa3-72fd78dd96d6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.846273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 460/927] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:41.855116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.855499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.855783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.887913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:41.889169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:41.920071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d4af3-1df2-4b84-9aa3-72fd78dd96d6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:41.961099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9IY7J6FxQ0SwBAdlMcuEhQ, audit_chain_id=['9IY7J6FxQ0SwBAdlMcuEhQ']) at 0x7fe8a158d850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:41.961766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:41.962082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:41.962308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:41.962990 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:41.967754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:41.985058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 468/928] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/services => generated 1497 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:41:41.985058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:41.996807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 461/929] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:42.030063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.121860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f5846-539d-4291-b052-9e196de8b8b9 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.174430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a1a0c880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.175759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.176224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.176709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.189293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:42.198467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:42.199997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:42.200850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:42.203151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 469/930] 10.222.0.49 () {56 vars in 1120 bytes} [Fri May 13 12:41:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:42.209887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.235232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248537f4-6c8c-4dee-af27-023f4ecef80a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.271861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qAK389m4SieCVoJ_rbqrTw, audit_chain_id=['qAK389m4SieCVoJ_rbqrTw']) at 0x7fe8a1490910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.272662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.272938 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.274061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.274699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.277131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:42.296256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:42.297258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:42.298093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 462/931] 10.222.0.49 () {56 vars in 1132 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:42.305282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.348912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9b0fd9-6ea7-465e-9ee8-11657b3af379 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.393152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a1573190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.394664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.395167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.395650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.396920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:42.397772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.399788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.411253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 470/932] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:42.417464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.424152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d720ddcf-8b8c-4b01-a38d-784345fe5a57 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.458681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qAK389m4SieCVoJ_rbqrTw, audit_chain_id=['qAK389m4SieCVoJ_rbqrTw']) at 0x7fe8a1563730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.459395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.459675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.459944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.460643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:42.460942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.462503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.474799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 463/933] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:42.475894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.548716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7407d30-107c-4ff3-8e69-a3945090e174 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.584972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a160e280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.585813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.586090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.586414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.598019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.599453 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.601865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812384d3-1303-411e-bad4-5f9041e8af0f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:42.617101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:42.618007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:42.618882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:42.618882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:42.618882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:42.618882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:42.623598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 471/934] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:42.624891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.640390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qAK389m4SieCVoJ_rbqrTw, audit_chain_id=['qAK389m4SieCVoJ_rbqrTw']) at 0x7fe8a14f3850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.641433 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.641910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.642373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.643264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:42.643870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.645445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.655445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 464/935] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:42.657028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.727721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b39a0-551b-427c-8df4-653975a497cb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.760436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c021e5d-e45b-48a2-b33a-a8d01fed843d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.763346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a11da490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.764011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.764380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.764569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.765296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:42.765660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.767075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.784150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 472/936] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:42.785845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:42.800632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qAK389m4SieCVoJ_rbqrTw, audit_chain_id=['qAK389m4SieCVoJ_rbqrTw']) at 0x7fe8a15685b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.801618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.802076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.802525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.803463 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.805076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.833029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 465/937] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:42 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:42.913634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcd5ab-a733-4f1b-8697-ad5f0e70a40a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:42.960025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a160e6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:42.960958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:42.961258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:42.961527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:42.970295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:42.971618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:42.987657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:42.988772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:42.989901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 473/938] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:42.996944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:43.103484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10559ad-bb62-4fb5-a495-06ae317c6e55 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:43.140056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a15beca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:43.141171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.141670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.142136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.143166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:43.143683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:43.145318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:43.169157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 466/939] 10.222.0.49 () {56 vars in 1149 bytes} [Fri May 13 12:41:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:43.170858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:43.280053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7b8f7-2c6a-4cb3-80ce-3258decbb0fb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:43.318150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a14ee4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:43.319020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.319306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.319583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.331351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:43.332891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:43.351884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:43.352807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:43.353895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:43.353895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:43.353895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:43.353895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:43.353895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 474/940] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:43.360763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:43.473747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a25ebe3-01cb-4ba2-be01-c7c4451ce3c3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:43.514356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a1338670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:43.515823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.516532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.517381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.518895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:43.519652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:43.522261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:43.541154 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 467/941] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:43.543563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:43.644908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a3d83-d9c4-41b4-b90f-f6b931bd0f1a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:43.680310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a1581a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:43.681126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.681403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.681669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.694821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:43.696318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:43.718004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:43.719636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:43.721861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 475/942] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:43.732274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:43.841346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d303d7-07ca-4b0f-bd24-ba488c631f4f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:43.876768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a13aa250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:43.877808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.878291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.878754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.879768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:43.880265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:43.881965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d571e7-b71f-44d8-8f90-385f7b696a0e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:43.900024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 468/943] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:43.901795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:43.953305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123ffb0-5bd5-42d0-94e3-1e650c8f7343 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.953949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123ffb0-5bd5-42d0-94e3-1e650c8f7343 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.954458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4123ffb0-5bd5-42d0-94e3-1e650c8f7343 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.956248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 469/944] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:43.962210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:43.962494 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:43.962768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:43.984794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:43.986469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:44.028913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddef1e0-39a2-46ad-afa9-7f8a2f5d88a5 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:44.069249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 470/945] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:44.076657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=jw06RdlAS4uG1HgsGIRV1A, audit_chain_id=['jw06RdlAS4uG1HgsGIRV1A']) at 0x7fe8a1557520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:44.077826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.078260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.078766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/2efb260599b1451dba561f50c3f895e0/roles/b4e1ef2657e740fd94ebd133a0ae3d17` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.081384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=2efb260599b1451dba561f50c3f895e0, role_id=b4e1ef2657e740fd94ebd133a0ae3d17)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:44.082995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:44.091651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:44.109043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 476/946] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:41:43 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/2efb260599b1451dba561f50c3f895e0/roles/b4e1ef2657e740fd94ebd133a0ae3d17 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:41:44.231767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33e94e-b24f-4fa8-85fa-5417830aa38a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:44.272299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oQsiXWy5R8S_PwB2r7Rcfg, audit_chain_id=['oQsiXWy5R8S_PwB2r7Rcfg']) at 0x7fe8a31910a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:44.272997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.273283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.273556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.274345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:44.275802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:44.277265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.common [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 13 12:41:44.299806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.sql.core [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 12:41:44.299806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 12:41:44.299806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [parameters: {'id': 'ed227c5c93d9433482396ca4c3375d30', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 12:41:44.299806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-ec9ccab3-a03c-466c-89cd-91f055129698 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed227c5c93d9433482396ca4c3375d30.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed227c5c93d9433482396ca4c3375d30. May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result = self._query(query) May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application conn.query(q) May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 12:41:44.316836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result.read() May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 13 12:41:44.318119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return project_ref.to_dict() May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application next(self.gen) May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application yield resource May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application next(self.gen) May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.session.rollback() May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.force_reraise() May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise self.value May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application session.commit() May 13 12:41:44.320080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._prepare_impl() May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.session.flush() May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._flush(objects) May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application compat.raise_( May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application flush_context.execute() May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 12:41:44.321508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rec.execute(self) May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application c = connection._execute_20( May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 12:41:44.322968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result = self._query(query) May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application conn.query(q) May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result.read() May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 12:41:44.324891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [parameters: {'id': 'ed227c5c93d9433482396ca4c3375d30', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.327897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:44.332760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.Conflict( May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ed227c5c93d9433482396ca4c3375d30. May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.333900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 471/947] 10.222.0.49 () {60 vars in 1140 bytes} [Fri May 13 12:41:44 2022] POST /identity/v3/projects => generated 262 bytes in 228 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:44.342135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:44.425921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e6be4-57c5-44df-abde-4eb554359c40 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.426365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e6be4-57c5-44df-abde-4eb554359c40 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.426706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e6be4-57c5-44df-abde-4eb554359c40 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.432265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 472/948] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:44.437478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.437966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.438414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.456170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d3510-4f5a-4f56-a626-66f8f6d7f09d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:44.457628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:44.459431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:44.491540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oQsiXWy5R8S_PwB2r7Rcfg, audit_chain_id=['oQsiXWy5R8S_PwB2r7Rcfg']) at 0x7fe8a155ae20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:44.492348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.492705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.493081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.500499 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:44.502067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:44.517703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:44.518806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:44.519894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:44.521997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 477/949] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:44.527807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:44.549018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 473/950] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:44.566391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:44.636554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcae790-73eb-4230-b1a9-d33901849c5c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:44.672324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be01444-ce7c-4197-a97a-db1fcba6586d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:44.672666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=oQsiXWy5R8S_PwB2r7Rcfg, audit_chain_id=['oQsiXWy5R8S_PwB2r7Rcfg']) at 0x7fe8a15dfd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:44.673456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.673811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.674156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.675105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:44.675500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:44.677019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:44.695776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 478/951] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:44.710955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_md4dfHkRiKhGhu2htIQrw, audit_chain_id=['_md4dfHkRiKhGhu2htIQrw']) at 0x7fe8a14c60a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:44.712186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.712651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.713099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.714282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:44.716149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:44.732011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:44.733720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:44.734802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:44.742384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 474/952] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:44.744035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:44.863465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57b211-885c-47b4-bef8-3460ad158736 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:44.903659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_md4dfHkRiKhGhu2htIQrw, audit_chain_id=['_md4dfHkRiKhGhu2htIQrw']) at 0x7fe8a1812b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:44.904436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:44.904816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:44.905194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:44.905986 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:44.906370 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:44.907823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:44.917608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 479/953] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:44.924097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:45.043291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14b99a-cc3e-41d6-a23b-7982de5a7a53 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:45.082035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_md4dfHkRiKhGhu2htIQrw, audit_chain_id=['_md4dfHkRiKhGhu2htIQrw']) at 0x7fe8a14e8fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:45.083044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.083532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.083986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.084904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:45.085429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:45.087031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da281fe3-8138-416c-b4b0-aa22dae6d430 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:45.093724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 475/954] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:45.099814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:45.205213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96a304-64cf-425f-9e48-e18ccc5a9513 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:45.242186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=_md4dfHkRiKhGhu2htIQrw, audit_chain_id=['_md4dfHkRiKhGhu2htIQrw']) at 0x7fe8a153f8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:45.243147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.243639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.244091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.245696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:45.247360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:45.261932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8ba7-8993-4478-952f-4d1edd45fd83 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.262788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8ba7-8993-4478-952f-4d1edd45fd83 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.263273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbe8ba7-8993-4478-952f-4d1edd45fd83 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.264923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 476/955] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:45.270328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.270720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.271061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.273295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 480/956] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:45.289110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:45.290442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:45.381378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 477/957] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:45.406577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:45.514610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2110ed-60be-472d-a770-066af33b146e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:45.551209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JrJGBKqvQf2-d4yM2qc_EQ, audit_chain_id=['JrJGBKqvQf2-d4yM2qc_EQ']) at 0x7fe8a15820a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:45.552383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.552871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.553407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.554278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:45.555849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:45.570248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:45.571323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:45.572165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:45.575191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 481/958] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:45.581278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:45.680185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4580d0-baa1-44a4-bcb9-e2630acd807a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:45.715134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JrJGBKqvQf2-d4yM2qc_EQ, audit_chain_id=['JrJGBKqvQf2-d4yM2qc_EQ']) at 0x7fe8a1838b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:45.715807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.716088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.716364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.717160 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:45.717473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:45.718850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d562e0-26c2-4342-85ad-a01d9daefb5f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:45.723944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 478/959] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:45.729579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:45.829411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43657d-7286-4e92-a542-d766d280e8c5 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:45.862949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JrJGBKqvQf2-d4yM2qc_EQ, audit_chain_id=['JrJGBKqvQf2-d4yM2qc_EQ']) at 0x7fe8a160c4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:45.863629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:45.863911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:45.864186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:45.864901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:45.865241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:45.866617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ec48b-ab54-4af5-b5da-9ab0c56d2705 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:45.872445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 482/960] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:45 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:46.571124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac215a5-169b-469e-98be-99682b6cfacf None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:46.571683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac215a5-169b-469e-98be-99682b6cfacf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:46.571683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac215a5-169b-469e-98be-99682b6cfacf None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:46.573485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 479/961] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:46.579483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:46.580035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:46.580035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:46.597573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:46.598749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:46.673073 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 483/962] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:46.691200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac215a5-169b-469e-98be-99682b6cfacf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:46.798749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac215a5-169b-469e-98be-99682b6cfacf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:46.832930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a1579850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:46.833690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:46.833965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:46.834227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:46.845256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:46.853260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:46.856071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:46.858552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:46.860270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 480/963] 10.222.0.49 () {56 vars in 1120 bytes} [Fri May 13 12:41:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:46.865008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:46.966783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7542e1-e957-462a-8dc9-5bc6f3e7ac18 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.002368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a15869d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.003057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.003337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.003611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.004384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:47.004691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.006128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.016910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 484/964] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:41:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:47.022505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.126931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3e228-bdf0-4740-b178-3929078d40f0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.164997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a14e28e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.165871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.166149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.166484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.180221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.181721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-65ee92a3-9ee7-4f0b-8e73-ad4b000685b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:47.202004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:47.206305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:47.208695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:47.208695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:47.208695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:47.208695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.208695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 481/965] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:47.212116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.223469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641afe4-2cc9-4019-b49d-356f981199a4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.224049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641afe4-2cc9-4019-b49d-356f981199a4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.224627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641afe4-2cc9-4019-b49d-356f981199a4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.226690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 482/966] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:47.234758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.235297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.235765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.256387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:47.258894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:47.339531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3038f-a48e-4869-a09e-3341c43f466b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.341311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 483/967] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:47.365181 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.379115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a14eabb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.380096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.380574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.381065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.381995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:47.382511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.384070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.397515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 485/968] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:47.403725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.486226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2a057-5336-4101-a007-e726e8334c73 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.531917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UCbgvc6bS8uSL6GWNDcnCQ, audit_chain_id=['UCbgvc6bS8uSL6GWNDcnCQ']) at 0x7fe8a187ddc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.532589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.532857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.533133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.533846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.535531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.536751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ccbd3-9eed-47cc-96ad-95441cb5da5b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.550837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.sql.core [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 12:41:47.550837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 12:41:47.550837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [parameters: {'user_id': '6502248d494f422dac8bfe0f923ac81b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 12:41:47.550837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result = self._query(query) May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application conn.query(q) May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result.read() May 13 12:41:47.559174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 12:41:47.560138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application next(self.gen) May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application yield resource May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application next(self.gen) May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.session.rollback() May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.force_reraise() May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise self.value May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application session.commit() May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 13 12:41:47.565523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._prepare_impl() May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.session.flush() May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._flush(objects) May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application compat.raise_( May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application flush_context.execute() May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rec.execute(self) May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 13 12:41:47.566472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application _emit_insert_statements( May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result = connection._execute_20( May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ret = self._execute_context( May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 13 12:41:47.567784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self.dialect.do_execute( May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result = self._query(query) May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application conn.query(q) May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application result.read() May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 13 12:41:47.568705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application packet.raise_for_error() May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [parameters: {'user_id': '6502248d494f422dac8bfe0f923ac81b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:47.569816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 13 12:41:47.570940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.572505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 484/969] 10.222.0.49 () {60 vars in 1131 bytes} [Fri May 13 12:41:47 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:47.575055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.594643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a15fc4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.595430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.595710 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.595980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.603932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.605502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:47.621739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:47.622785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:47.628918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 486/970] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:47.631498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.693393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22115578-9925-466f-bdcb-ac28903f7d09 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.730558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UCbgvc6bS8uSL6GWNDcnCQ, audit_chain_id=['UCbgvc6bS8uSL6GWNDcnCQ']) at 0x7fe8a1563e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.731857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.732283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.732697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.744351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.747334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.753589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42841590-c2bb-418b-8e0f-591faa9faffd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-48188d37-01cf-4d3f-876f-3d2932806dbb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:47.766282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:47.767486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:47.768448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 485/971] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:47.769086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7a43c-0969-458e-b367-fe1800a647ce None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.769322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7a43c-0969-458e-b367-fe1800a647ce None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.769570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7a43c-0969-458e-b367-fe1800a647ce None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.773985 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 486/972] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:47.774791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7a43c-0969-458e-b367-fe1800a647ce None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.794260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a1581d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.794933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.795217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.795493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.796331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:47.796643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.798108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc443b72-1b6e-4ce7-95f8-7b41680d466d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.820274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 487/973] 10.222.0.49 () {56 vars in 1149 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:47.820274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.820274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.820274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.833956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:47.835430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:47.884025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7a43c-0969-458e-b367-fe1800a647ce None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:47.907809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 488/974] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:47.908028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:47.920696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=UCbgvc6bS8uSL6GWNDcnCQ, audit_chain_id=['UCbgvc6bS8uSL6GWNDcnCQ']) at 0x7fe8a14e41c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:47.924783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:47.924783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:47.924783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:47.926692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:47.927576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:47.930552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:47.973599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 487/975] 10.222.0.49 () {56 vars in 1101 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:47.974502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.042575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a40fb-b6a7-4db7-8a22-d0eba9bea4c6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.083693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ee41e-3b73-412b-abdb-32410ff4b627 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a1571850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.084740 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ee41e-3b73-412b-abdb-32410ff4b627 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.085287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ee41e-3b73-412b-abdb-32410ff4b627 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.085782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ee41e-3b73-412b-abdb-32410ff4b627 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.091069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288147b-9959-4f66-8618-89b4da4189f5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.130156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=enRjv5pzTUOGmAUd8_hdGg, audit_chain_id=['enRjv5pzTUOGmAUd8_hdGg']) at 0x7fe8a1434670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.131485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.131485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.131783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.132533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.134518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:48.148256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:48.149441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:48.150300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:48.155417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 488/976] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:48.156425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.169614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ee41e-3b73-412b-abdb-32410ff4b627 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.171477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ee41e-3b73-412b-abdb-32410ff4b627 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.269926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eedaa2-58f6-41c4-9216-d2986942db51 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.288429 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 489/977] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:47 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:41:48.289642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226330ae-c817-4e49-ae20-2458157c2017 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.289935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226330ae-c817-4e49-ae20-2458157c2017 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.290214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226330ae-c817-4e49-ae20-2458157c2017 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.291619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 490/978] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:48.295793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226330ae-c817-4e49-ae20-2458157c2017 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.306373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=enRjv5pzTUOGmAUd8_hdGg, audit_chain_id=['enRjv5pzTUOGmAUd8_hdGg']) at 0x7fe8a14dcf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.307032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.307306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.307912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.308621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:48.308924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.310306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d5c0b-8c38-4470-aa34-93ed78401b80 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.315094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 489/979] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:48.316252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.316692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.316970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.333733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:48.335133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:48.399822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 490/980] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:48.400486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226330ae-c817-4e49-ae20-2458157c2017 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.400693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.433478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a25226d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.434293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.434570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.434842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.445273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.446707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:48.465721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:48.466742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:48.467662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:48.467662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:48.467662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:48.467662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:48.467662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 491/981] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:48.468094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.500748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ce43c-4cb0-48e0-b7b2-fef3b9a429a4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.539943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=enRjv5pzTUOGmAUd8_hdGg, audit_chain_id=['enRjv5pzTUOGmAUd8_hdGg']) at 0x7fe8a14f3400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.540609 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.540891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.541193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.542383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:48.542703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.544073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.549058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 491/982] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:48.549638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.575823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4232-1c36-488f-bf8b-a488a146959b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.609494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hCPVO7nmTwawYkPSchIe0A, audit_chain_id=['hCPVO7nmTwawYkPSchIe0A']) at 0x7fe8a15703d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.610155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.610439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.610716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.611430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.612796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.626915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 492/983] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:48 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:48.627717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.648150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a50bae-6418-484e-9b2c-4658ad701f0f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.699700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a14f30a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.700458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.700841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.701200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.701939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:48.702272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.703669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.719849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 492/984] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:48.726158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.745868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d154e4-df07-4e38-9984-9c119862308c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.782333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=enRjv5pzTUOGmAUd8_hdGg, audit_chain_id=['enRjv5pzTUOGmAUd8_hdGg']) at 0x7fe8a160ed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.783078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.783359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.783634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.784478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] RBAC: Adding query filter params (interface=admin, service_id=5c17be3fe06a440995d04eaa24325994, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:48.784788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.786228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.791902 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 493/985] 10.222.0.49 () {56 vars in 1249 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/endpoints?service_id=5c17be3fe06a440995d04eaa24325994&interface=admin®ion_id=RegionOne => generated 193 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:48.798884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.835440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9d85-09fa-4399-ab81-7759b815a9ba None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.874119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a14fba30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.875280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.875825 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.876331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.883583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.885046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:48.900515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:48.902342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:48.903254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:48.905059 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 493/986] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:48.907968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5299cf-be94-479a-b73e-297c29e9696b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:48.909788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:48.943946 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=enRjv5pzTUOGmAUd8_hdGg, audit_chain_id=['enRjv5pzTUOGmAUd8_hdGg']) at 0x7fe8a19a3610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:48.944618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:48.944900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:48.945207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:48.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:48.947272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:48.961312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 494/987] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:41:49.018750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127bb5f-de14-420f-882d-ecc289bd99df None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:49.056076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a14ee6d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:49.056813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:49.057130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:49.057496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:49.058458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:49.058776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:49.060259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bef5ee-71ef-4800-b9f0-0d69a0e4683e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:49.079055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 494/988] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:49.080282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:49.193273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b02a07-c65d-40a5-855e-95865495b4db None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:49.227159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ZCwsU7_pRzyziBSvH9zeJA, audit_chain_id=['ZCwsU7_pRzyziBSvH9zeJA']) at 0x7fe8a160eeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:49.227775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:49.228062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:49.228337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:49.229891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] RBAC: Adding query filter params (role.id=b4e1ef2657e740fd94ebd133a0ae3d17, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=2efb260599b1451dba561f50c3f895e0) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:49.230204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:49.231649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19eec9-2b37-496a-8daf-4bf4b56e0398 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:49.238211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 495/989] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:41:49 2022] GET /identity/v3/role_assignments?user.id=2efb260599b1451dba561f50c3f895e0&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b4e1ef2657e740fd94ebd133a0ae3d17 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:50.975827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525845-8ad1-4a9e-a179-44f1899699a0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:50.976295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525845-8ad1-4a9e-a179-44f1899699a0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:50.976383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb525845-8ad1-4a9e-a179-44f1899699a0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:50.977923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 495/990] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:50.983791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e6f5-39ef-4648-b58b-161f5a986762 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:50.984192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e6f5-39ef-4648-b58b-161f5a986762 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:50.984356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979e6f5-39ef-4648-b58b-161f5a986762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.001994 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4979e6f5-39ef-4648-b58b-161f5a986762 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:51.003179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4979e6f5-39ef-4648-b58b-161f5a986762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:51.077676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 496/991] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:51.100281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525845-8ad1-4a9e-a179-44f1899699a0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.204262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb525845-8ad1-4a9e-a179-44f1899699a0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.233200 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8c52-134a-4795-8cb7-00af7115d0ba None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.233479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8c52-134a-4795-8cb7-00af7115d0ba None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.233678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f8c52-134a-4795-8cb7-00af7115d0ba None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.235172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 497/992] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:51.241930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ieizx6FET0Ou8oIRhIg4PA, audit_chain_id=['ieizx6FET0Ou8oIRhIg4PA']) at 0x7fe8a14d30a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.241930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.241930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.242265 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.242363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.242447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.242447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.242611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.242611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:51.255152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:51.256208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:51.257525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:51.259549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:51.260784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:51.261378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 496/993] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:51.263145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.338833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 498/994] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:51.362255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.371878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3cb2c0-bb9b-46ae-9505-9b08d4f33974 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.404748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ieizx6FET0Ou8oIRhIg4PA, audit_chain_id=['ieizx6FET0Ou8oIRhIg4PA']) at 0x7fe8a14fba30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.405441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.405718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.405989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.406691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:51.406997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.408371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.413115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 497/995] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:51.419388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.460431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2add993a-98e1-4862-a9f3-fc31ba1f148b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.497728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J711dkITS_uE3T5CA3oJoQ, audit_chain_id=['J711dkITS_uE3T5CA3oJoQ']) at 0x7fe8a15869d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.498451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.498732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.499130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.499662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.501040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-d275458b-84e9-439c-8ad2-dca14e9d6877 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:51.513351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:51.514392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:51.515245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 499/996] 10.222.0.49 () {56 vars in 1126 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:51.516326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9888b8-5141-44fe-9f94-e0912942b40b None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.516609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9888b8-5141-44fe-9f94-e0912942b40b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.517440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9888b8-5141-44fe-9f94-e0912942b40b None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.518826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 500/997] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:51.521834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9888b8-5141-44fe-9f94-e0912942b40b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.525341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d036a-74c1-4d8e-9ae3-a783ae8bbab2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.562598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ieizx6FET0Ou8oIRhIg4PA, audit_chain_id=['ieizx6FET0Ou8oIRhIg4PA']) at 0x7fe8a14d3e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.563262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.563539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.563835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.564545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:51.564845 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.566240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf0b5b4-3205-40b7-bf4b-09d5ad02149f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.572590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 498/998] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:51.574115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.574399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.574672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.593910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:51.595091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:51.622208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9888b8-5141-44fe-9f94-e0912942b40b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.656191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J711dkITS_uE3T5CA3oJoQ, audit_chain_id=['J711dkITS_uE3T5CA3oJoQ']) at 0x7fe8a1464610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.656845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.657150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.657426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.658118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:51.658343 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 499/999] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:51.658491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.659219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.659846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.665025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 501/1000] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:51.670836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.758063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2c550-28fa-4483-92a7-7150c580799c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.765890 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a009-c3ec-4518-8872-777967e7b862 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.791128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ieizx6FET0Ou8oIRhIg4PA, audit_chain_id=['ieizx6FET0Ou8oIRhIg4PA']) at 0x7fe8a138f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.792434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.792714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.793003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.793785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] RBAC: Adding query filter params (interface=public, service_id=f45a90c4eb274e5599fa2e8fa0935036, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:51.794086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.795450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.799719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J711dkITS_uE3T5CA3oJoQ, audit_chain_id=['J711dkITS_uE3T5CA3oJoQ']) at 0x7fe8a1464b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.800246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 500/1001] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/endpoints?service_id=f45a90c4eb274e5599fa2e8fa0935036&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:51.800383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.800654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.800929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.801057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.801663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:51.801967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.803316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.812567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 502/1002] 10.222.0.49 () {56 vars in 1122 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:51.812567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.902935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f9a41-8b79-4685-9cc4-0a1015ec1ec9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.909101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a297da-39f6-44d6-95a9-0d9ce8903054 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:51.936230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hXwbYXe3TpOxgrT0lgxwaA, audit_chain_id=['hXwbYXe3TpOxgrT0lgxwaA']) at 0x7fe8a14dc760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.937033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.937318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.937586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] PATH_INFO: `/v3/services/image` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.945973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.946348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ieizx6FET0Ou8oIRhIg4PA, audit_chain_id=['ieizx6FET0Ou8oIRhIg4PA']) at 0x7fe8a2522550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:51.947012 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:51.947296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:51.947572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:51.947895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.949368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:51.950730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:51.956816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 503/1003] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:41:51.957614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:51.960166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:51.961203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:51.962035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 501/1004] 10.222.0.49 () {56 vars in 1105 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:51.969633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:52.071748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994dc651-12cd-4b88-b6bb-5f563c957263 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:52.079650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc614f8-0835-4466-ba83-8696168765d1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:52.118607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76199b43-44ab-4810-987e-b2e872fc395e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=J711dkITS_uE3T5CA3oJoQ, audit_chain_id=['J711dkITS_uE3T5CA3oJoQ']) at 0x7fe8a1202370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:52.119285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199b43-44ab-4810-987e-b2e872fc395e None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:52.119572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199b43-44ab-4810-987e-b2e872fc395e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:52.119880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76199b43-44ab-4810-987e-b2e872fc395e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:52.121338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76199b43-44ab-4810-987e-b2e872fc395e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:52.122795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76199b43-44ab-4810-987e-b2e872fc395e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:52.123151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hXwbYXe3TpOxgrT0lgxwaA, audit_chain_id=['hXwbYXe3TpOxgrT0lgxwaA']) at 0x7fe8a155e760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:52.123818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:52.124097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:52.124367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:52.125122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] RBAC: Adding query filter params (name=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:52.125427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:52.126803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:52.137224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 502/1005] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:52.139712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:52.141614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 504/1006] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:52.249354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daaaf89-3b59-4c35-b3b6-346d1c79c59b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:52.294761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=hXwbYXe3TpOxgrT0lgxwaA, audit_chain_id=['hXwbYXe3TpOxgrT0lgxwaA']) at 0x7fe8a155f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:52.295905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:52.296474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:52.297045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:52.298143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] RBAC: Adding query filter params (type=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:52.298745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:52.300592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd369f8-da53-4cd6-81cd-2c454eb02f59 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:52.307560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 503/1007] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:54.274572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470be6b-a89f-46e9-b319-8c53c9a52c5f None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.275323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470be6b-a89f-46e9-b319-8c53c9a52c5f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.275323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0470be6b-a89f-46e9-b319-8c53c9a52c5f None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.281041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 505/1008] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:54.285025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561da55-9e96-4400-a1b2-dd9b5c5ab730 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.285548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561da55-9e96-4400-a1b2-dd9b5c5ab730 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.285817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6561da55-9e96-4400-a1b2-dd9b5c5ab730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.309389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6561da55-9e96-4400-a1b2-dd9b5c5ab730 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:54.311279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6561da55-9e96-4400-a1b2-dd9b5c5ab730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:54.381069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 504/1009] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:54.404677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470be6b-a89f-46e9-b319-8c53c9a52c5f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.454520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2530-084e-46ee-9d8c-733509a52a20 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.454844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2530-084e-46ee-9d8c-733509a52a20 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.455137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd2530-084e-46ee-9d8c-733509a52a20 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.456544 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 505/1010] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:54.461368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809b6f-ef53-43b6-a286-96abb9644b06 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.461651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809b6f-ef53-43b6-a286-96abb9644b06 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.461923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18809b6f-ef53-43b6-a286-96abb9644b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.479464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-18809b6f-ef53-43b6-a286-96abb9644b06 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:54.480809 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-18809b6f-ef53-43b6-a286-96abb9644b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:54.511784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0470be6b-a89f-46e9-b319-8c53c9a52c5f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:54.545986 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qy3uBBBLR6ehUu5qkwT97Q, audit_chain_id=['Qy3uBBBLR6ehUu5qkwT97Q']) at 0x7fe8a14fb250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:54.546691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.546973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.547238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.547878 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:54.549268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 506/1011] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:54.549380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:54.550459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62d29-0dfc-4911-a8d6-1d822298fa0c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.550742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62d29-0dfc-4911-a8d6-1d822298fa0c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.551133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a62d29-0dfc-4911-a8d6-1d822298fa0c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.553016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 507/1012] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:54.557540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.558075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.558606 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:54.562908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:54.564105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 13 12:41:54.565240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:54.569178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 506/1013] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:54.570017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.579579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:54.581575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:54.647073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 508/1014] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:54.647955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.673982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc4172-0b63-4aa8-a0c4-a7b5ebbb5be5 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:54.706410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qy3uBBBLR6ehUu5qkwT97Q, audit_chain_id=['Qy3uBBBLR6ehUu5qkwT97Q']) at 0x7fe8a1190940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:54.707066 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.707339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.707608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.708298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] RBAC: Adding query filter params (name=compute) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:54.708599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:54.710052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:54.715339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 507/1015] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:54.716120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.747151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c323-bb8e-479f-a9aa-7557f0563aac None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:54.780016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4cLx0mBkTba1xSV431xpYA, audit_chain_id=['4cLx0mBkTba1xSV431xpYA']) at 0x7fe8a15155b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:54.780793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.781094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.781374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.782529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:54.783946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:54.785581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 509/1016] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:54.786333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.815016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdede2a5-9cce-47a2-be79-5c2a008b9a4f None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:54.846895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Pu9v9ixPSjydsNhR4KfPzw, audit_chain_id=['Pu9v9ixPSjydsNhR4KfPzw']) at 0x7fe8a1464b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:54.847552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.847835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.848109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.848816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:54.850211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:54.864823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 508/1017] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:54 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:54.865833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.890142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbe3b7-1b3a-4ec5-816c-40a521ad919e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:54.935165 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qy3uBBBLR6ehUu5qkwT97Q, audit_chain_id=['Qy3uBBBLR6ehUu5qkwT97Q']) at 0x7fe8a14f3040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:54.936179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:54.936460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:54.936739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:54.937491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:54.937797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:54.939179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:54.950373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 510/1018] 10.222.0.49 () {56 vars in 1112 bytes} [Fri May 13 12:41:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:54.951682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:54.978009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebed8c5-b43b-4264-815f-0266771e44de None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:55.013767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ae92b-6fe1-4f42-a985-75b5a8d59a8d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=4cLx0mBkTba1xSV431xpYA, audit_chain_id=['4cLx0mBkTba1xSV431xpYA']) at 0x7fe8a1604e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:55.014494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae92b-6fe1-4f42-a985-75b5a8d59a8d None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:55.014778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae92b-6fe1-4f42-a985-75b5a8d59a8d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:55.015049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ae92b-6fe1-4f42-a985-75b5a8d59a8d None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:55.015833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ae92b-6fe1-4f42-a985-75b5a8d59a8d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:55.017301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ae92b-6fe1-4f42-a985-75b5a8d59a8d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:55.054250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 509/1019] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:41:54 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:55.058617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8f9af-612b-4ce5-b9c7-f572a7a7e9cf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:55.100352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608820a-fcd5-49cf-93d9-e17004beb29a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Qy3uBBBLR6ehUu5qkwT97Q, audit_chain_id=['Qy3uBBBLR6ehUu5qkwT97Q']) at 0x7fe8a14da700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:55.100942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608820a-fcd5-49cf-93d9-e17004beb29a None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:55.101260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608820a-fcd5-49cf-93d9-e17004beb29a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:55.101533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608820a-fcd5-49cf-93d9-e17004beb29a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:55.102284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608820a-fcd5-49cf-93d9-e17004beb29a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:55.103676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608820a-fcd5-49cf-93d9-e17004beb29a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:55.126704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 511/1020] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:41:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:57.202843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8f5c-00de-47b2-bcfd-7b050a6ef9d8 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.202843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8f5c-00de-47b2-bcfd-7b050a6ef9d8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.202843 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd8f5c-00de-47b2-bcfd-7b050a6ef9d8 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.204149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 510/1021] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:57.210018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffd70e-1a41-491c-bdd4-703fa02ba070 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.210549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffd70e-1a41-491c-bdd4-703fa02ba070 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.210549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ffd70e-1a41-491c-bdd4-703fa02ba070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.227748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e0ffd70e-1a41-491c-bdd4-703fa02ba070 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:57.228848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e0ffd70e-1a41-491c-bdd4-703fa02ba070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:57.315811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 512/1022] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:57.338620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd8f5c-00de-47b2-bcfd-7b050a6ef9d8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:57.383317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734bfdb-690e-484f-afae-959ed04d82b3 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.383697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734bfdb-690e-484f-afae-959ed04d82b3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.383880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734bfdb-690e-484f-afae-959ed04d82b3 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.385379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 513/1023] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:41:57.391588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.391960 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.392139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.418013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:57.419202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:57.453879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd8f5c-00de-47b2-bcfd-7b050a6ef9d8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:57.490941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086678-f7e1-4028-8595-3a892860619d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8daWcVdRJ6onjDSE3CDJQ, audit_chain_id=['r8daWcVdRJ6onjDSE3CDJQ']) at 0x7fe8a15704c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:57.491614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086678-f7e1-4028-8595-3a892860619d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.491891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086678-f7e1-4028-8595-3a892860619d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.492163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08086678-f7e1-4028-8595-3a892860619d None admin] PATH_INFO: `/v3/services/image` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.492817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086678-f7e1-4028-8595-3a892860619d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:57.494215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08086678-f7e1-4028-8595-3a892860619d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-08086678-f7e1-4028-8595-3a892860619d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:57.507308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:57.508555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:41:57.509525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:57.513442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 511/1024] 10.222.0.49 () {56 vars in 1105 bytes} [Fri May 13 12:41:57 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:57.514542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 514/1025] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:41:57.514896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086678-f7e1-4028-8595-3a892860619d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:57.545573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:57.644532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08086678-f7e1-4028-8595-3a892860619d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:57.659151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64189b50-e68e-4a8a-9913-336e2a1959bf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:57.692934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8daWcVdRJ6onjDSE3CDJQ, audit_chain_id=['r8daWcVdRJ6onjDSE3CDJQ']) at 0x7fe8a1573970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:57.693632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.693915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.694192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.694901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] RBAC: Adding query filter params (name=image) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:57.695218 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:57.696593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901da8eb-7a00-4692-9503-f468a17611da None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:57.700004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JuL-xgshRhinko1hEHcfzg, audit_chain_id=['JuL-xgshRhinko1hEHcfzg']) at 0x7fe8a14fa250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:57.700835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.701194 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.701578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.702807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:57.703105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 512/1026] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:57.704218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:57.710600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 515/1027] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:57.710600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:57.710930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993daf1d-774c-4b96-9d03-a038dbd50e41 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.710930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993daf1d-774c-4b96-9d03-a038dbd50e41 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.710930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993daf1d-774c-4b96-9d03-a038dbd50e41 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.711423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 513/1028] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:41:57.711693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993daf1d-774c-4b96-9d03-a038dbd50e41 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:57.816571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20295a4d-9d2c-499b-8fd0-43c48b9595de None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:57.830768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993daf1d-774c-4b96-9d03-a038dbd50e41 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:57.857514 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8daWcVdRJ6onjDSE3CDJQ, audit_chain_id=['r8daWcVdRJ6onjDSE3CDJQ']) at 0x7fe8a1549610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:57.858202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.858506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.858775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.859485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] RBAC: Adding query filter params (type=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:57.859781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:57.861167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528e36ed-8022-45eb-9aaf-054b87fdc908 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:57.866048 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 516/1029] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:57.867737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=JuL-xgshRhinko1hEHcfzg, audit_chain_id=['JuL-xgshRhinko1hEHcfzg']) at 0x7fe8a1581a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:57.868481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.868829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.869199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.869955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:57.870540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:57.870917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:57.871193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:57.871542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:57.888415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:41:57.889663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:41:57.895134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 514/1030] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:41:57 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:41:57.895994 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:57.974426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 517/1031] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:41:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:41:57.998323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:58.049807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed1c9a7-0be6-4246-a6d0-57a6279ba981 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.090909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8daWcVdRJ6onjDSE3CDJQ, audit_chain_id=['r8daWcVdRJ6onjDSE3CDJQ']) at 0x7fe8a1561d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.091496 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.091773 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.092040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.092841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] RBAC: Adding query filter params (interface=public, service_id=d17a5f2817c14028a37e9b293dab5911, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:58.093175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:58.094642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:58.101648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 515/1032] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:41:57 2022] GET /identity/v3/endpoints?service_id=d17a5f2817c14028a37e9b293dab5911&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:58.107481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:58.132471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836b76-f979-4c91-a173-51a9822ca646 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.171861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a14e8b50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.172419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.172699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.173050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.186884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:41:58.195478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:58.196745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:58.197648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 518/1033] 10.222.0.49 () {56 vars in 1120 bytes} [Fri May 13 12:41:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:58.203515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:58.216251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fe260-449b-4f3d-b556-ab7c55bfee58 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.250557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=r8daWcVdRJ6onjDSE3CDJQ, audit_chain_id=['r8daWcVdRJ6onjDSE3CDJQ']) at 0x7fe8a15f6e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.251223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.251500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.251771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.252540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:58.253822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:58.269024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 516/1034] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:41:58 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:41:58.309344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c54be-72d4-4e08-9a11-11a9c173d80c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.359717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a14e1a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.360347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.360627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.360901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.361750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:58.362069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:58.363585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:58.377589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 519/1035] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:41:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:58.379271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:58.486838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23759b95-5855-4ed6-a74a-7063f2d04d75 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.521096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a160adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.521903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.522182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.522455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.534013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:58.535874 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:58.557134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:58.558537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:58.559431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:58.559431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:58.559431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:58.559431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:58.559431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 517/1036] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:58.565449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:58.677167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b788f5-b2dc-4064-9a27-4e17e86abf75 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.710796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a138f280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.711456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.711736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.712008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.712722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:58.713052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:58.715081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:58.731336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 520/1037] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:58.732817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:58.831030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25ffe0-6975-4c5a-bfa5-15badac2e72b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:58.863971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a1190610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:58.864754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:58.865289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:58.865479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:58.872917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:58.874373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:41:58.888728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:58.889836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:41:58.895825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 518/1038] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:41:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:58.896435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:59.002623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959b8cd-c272-419c-b14e-3ec32793d5de None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:59.037209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a15be490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:59.037881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:59.038164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:59.038435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:59.039273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:59.039579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:59.041022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:59.063239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 521/1039] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:41:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:41:59.064366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:59.169218 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d389525-49ac-48df-b674-a1786e11bffe None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:59.203924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a160cc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:59.204576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:59.204861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:59.205168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:59.276160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:59.278560 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:59.387501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 519/1040] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:41:59 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:41:59.394152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:59.504905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb910ccd-4ecf-4bfd-ab2f-6c85fdbe5935 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:59.539858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a14dab20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:59.540566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:59.540844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:59.541183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:59.551818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:59.554135 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:41:59.573952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:59.574862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:59.583621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:41:59.583621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:41:59.583621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:41:59.583621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:59.583621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 522/1041] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:41:59.583901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:59.686180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388b1c67-675f-4de1-8a3c-4b3da30e0247 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:59.722460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a1524850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:59.723188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:59.723468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:59.723736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:59.724449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:41:59.724748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:59.726157 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:59.741963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 520/1042] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:41:59.743676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:41:59.850988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fa68a-4dad-400f-b14b-2a5a0aaff602 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:41:59.888920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a1532220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:41:59.889737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:41:59.890066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:41:59.890256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:41:59.897194 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:41:59.898625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:41:59.912332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:41:59.913300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:41:59.914208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 523/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:41:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:41:59.919401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.019522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0ab11-a76e-4571-8d0f-ac91984454a2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.054228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a1582640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.054894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.055173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.055440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.056227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:00.056531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:00.058799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac2c1e9-06b3-46dc-ba71-f0ea5f3189cc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:00.077018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 521/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:41:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:00.080254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.196539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c34fb-261e-4655-8c05-a8a8fdd90758 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.230529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rKvfEGIORHWVKA48FyW-rw, audit_chain_id=['rKvfEGIORHWVKA48FyW-rw']) at 0x7fe8a1515130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.231173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.231447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.231713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.232525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] RBAC: Adding query filter params (role.id=b4e1ef2657e740fd94ebd133a0ae3d17, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=97df92a4d0e543f79e611b9bfd03e1c3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:00.232826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:00.234263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a2d91-3c5c-4a99-9441-235986e04e0b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:00.239915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 524/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/role_assignments?user.id=97df92a4d0e543f79e611b9bfd03e1c3&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b4e1ef2657e740fd94ebd133a0ae3d17 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:00.327282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130a98-5ff8-4a2f-b4fd-9ac3e94821e0 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.327833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130a98-5ff8-4a2f-b4fd-9ac3e94821e0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.327833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9130a98-5ff8-4a2f-b4fd-9ac3e94821e0 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.329387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 522/1046] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:00.334886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e5f02-3c60-4f20-a27d-d2726a0d163c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.335183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e5f02-3c60-4f20-a27d-d2726a0d163c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.335444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e5f02-3c60-4f20-a27d-d2726a0d163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.353512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a91e5f02-3c60-4f20-a27d-d2726a0d163c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:00.354833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a91e5f02-3c60-4f20-a27d-d2726a0d163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:00.439555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 525/1047] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:00.462729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130a98-5ff8-4a2f-b4fd-9ac3e94821e0 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.564955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9130a98-5ff8-4a2f-b4fd-9ac3e94821e0 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.568710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73871-dab1-4e43-899d-adde83f85c3c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.569184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73871-dab1-4e43-899d-adde83f85c3c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.569474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a73871-dab1-4e43-899d-adde83f85c3c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.573477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 526/1048] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:00.576755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.577073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.577353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.595454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:00.596638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:00.599941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GXxlVFpjQoi-kRHzPeLmlQ, audit_chain_id=['GXxlVFpjQoi-kRHzPeLmlQ']) at 0x7fe8a1570850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.600738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.601023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.601299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.611600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:00.619028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:00.620508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:00.621433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 523/1049] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:00.626717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.678832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 527/1050] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:42:00.703085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.732299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb3cfec-77d5-4720-b5ce-73a865e7291d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.766690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GXxlVFpjQoi-kRHzPeLmlQ, audit_chain_id=['GXxlVFpjQoi-kRHzPeLmlQ']) at 0x7fe8a1557310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.767364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.767653 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.767926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.768670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:00.768990 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:00.770368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:00.780930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 524/1051] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:00.786650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.802749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c83b17-4222-4781-aee1-bbeb52a1ad14 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.835484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9rGML8uORTi9FZIs-UA5wA, audit_chain_id=['9rGML8uORTi9FZIs-UA5wA']) at 0x7fe8a14f0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.836253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.836529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.836800 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] PATH_INFO: `/v3/services/image` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.837472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:00.839369 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:00.850645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:00.851698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:00.852565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 528/1052] 10.222.0.49 () {56 vars in 1105 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:00.858854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.892486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d7236-4b60-4370-83d3-26fbf871c359 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.927276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GXxlVFpjQoi-kRHzPeLmlQ, audit_chain_id=['GXxlVFpjQoi-kRHzPeLmlQ']) at 0x7fe8a1464e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.928197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.928507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.928801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] PATH_INFO: `/v3/users/09ff89503410441c9625caba3365657d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:00.942666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] RBAC: Authorizing `identity:get_user(user_id=09ff89503410441c9625caba3365657d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:00.944222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:00.951226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 525/1053] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/users/09ff89503410441c9625caba3365657d => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:00.952249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:00.960444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303063e-bbe0-4226-aaf3-05edf244e440 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:00.998390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9rGML8uORTi9FZIs-UA5wA, audit_chain_id=['9rGML8uORTi9FZIs-UA5wA']) at 0x7fe8a155faf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:00.998973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:00.999253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:00.999523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:01.000273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] RBAC: Adding query filter params (name=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:01.000580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:01.002105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:01.007145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 529/1054] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:01.013779 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:01.055969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9dc74-262c-49f7-a478-3e6b42f35bf4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:01.090689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GXxlVFpjQoi-kRHzPeLmlQ, audit_chain_id=['GXxlVFpjQoi-kRHzPeLmlQ']) at 0x7fe8a15708b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:01.091341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:01.091627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:01.091883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:01.114176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0f1897-8be3-4954-9e2c-4efb41976b6c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:01.148541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9rGML8uORTi9FZIs-UA5wA, audit_chain_id=['9rGML8uORTi9FZIs-UA5wA']) at 0x7fe8a14f3040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:01.149306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:01.149586 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:01.149858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:01.150555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:01.150857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:01.152960 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:01.157792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 530/1055] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:01.160120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:01.161586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:01.163587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:01.263592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 526/1056] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:01.268253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:01.271556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc03cec-5b2f-4c08-ac89-bbb6257586e2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:01.306451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9rGML8uORTi9FZIs-UA5wA, audit_chain_id=['9rGML8uORTi9FZIs-UA5wA']) at 0x7fe8a14e5ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:01.307121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:01.307435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:01.308205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:01.308951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:01.310347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:01.341015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 531/1057] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:42:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:42:01.376826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3767a91-d8b5-43e4-9b6b-52b79c4e4ab4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:01.423829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b9290-2383-4399-a17a-de67ff2baa53 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GXxlVFpjQoi-kRHzPeLmlQ, audit_chain_id=['GXxlVFpjQoi-kRHzPeLmlQ']) at 0x7fe8a19a3670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:01.424688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9290-2383-4399-a17a-de67ff2baa53 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:01.425181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9290-2383-4399-a17a-de67ff2baa53 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:01.425459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b9290-2383-4399-a17a-de67ff2baa53 None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:01.426694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b9290-2383-4399-a17a-de67ff2baa53 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7cb6c0dbcc41698be4551a67c65e16)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:01.428157 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b9290-2383-4399-a17a-de67ff2baa53 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:01.430124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 527/1058] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:01 2022] GET /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:01.436353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:01.550342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794a77da-9c65-4921-8a2b-55faeff97368 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:01.585635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=GXxlVFpjQoi-kRHzPeLmlQ, audit_chain_id=['GXxlVFpjQoi-kRHzPeLmlQ']) at 0x7fe8a13e9b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:01.586287 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:01.586564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:01.586831 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:01.587657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16, user.id=09ff89503410441c9625caba3365657d) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:01.587965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:01.590225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ecd20-7b06-4d81-aeac-1bf7a50f3a4d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:01.595897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 532/1059] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:01 2022] GET /identity/v3/role_assignments?user.id=09ff89503410441c9625caba3365657d&scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:02.517907 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21df6-4b69-4e3d-80e3-a6c1904a7110 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:02.518484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21df6-4b69-4e3d-80e3-a6c1904a7110 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:02.518484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba21df6-4b69-4e3d-80e3-a6c1904a7110 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:02.519774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 528/1060] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:02.525220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:02.525503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:02.525779 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:02.543780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:02.544950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:02.613075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 533/1061] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:02.636216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21df6-4b69-4e3d-80e3-a6c1904a7110 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:02.744320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba21df6-4b69-4e3d-80e3-a6c1904a7110 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:02.781434 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a1a0c880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:02.782176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:02.782464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:02.782736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:02.793766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:02.801766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:02.803082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:02.804233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 529/1062] 10.222.0.49 () {56 vars in 1120 bytes} [Fri May 13 12:42:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:02.809233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:02.908630 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bf2561-dd14-4fd2-afc3-81a4aa7481dd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:02.946539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a14e8dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:02.947210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:02.947533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:02.947809 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:02.949347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:02.949502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:02.950917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:02.959494 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 534/1063] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:42:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:02.968673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.081137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97622819-f7d6-41cb-aa83-8d3152f2fe64 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.117408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a14e44c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.118253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.118477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.118750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.130630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.132518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:42:03.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:03.158956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:03.159959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:42:03.159959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:42:03.159959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:03.159959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:03.161300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 530/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:03.164427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.266058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f92351-0105-440e-a440-82b17e2356a4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.298320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a1505610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.298974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.299249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.299516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.300228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:03.300528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.302019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.318672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 535/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:03.320111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.432145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f73d6-7d48-44a0-b049-51b1c66250b2 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.468722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a14e9cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.469551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.469861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.470108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.478056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.480633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-210b2ea9-83e4-418d-b845-c5bf65391a78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:42:03.494847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:03.496509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:03.502637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 531/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:03.503560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.601712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46347e24-ca35-4805-bb71-5517c2a31bc2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.605871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9469d9-a4c4-4199-adbf-11dd0c962e5f None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.606491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9469d9-a4c4-4199-adbf-11dd0c962e5f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.606491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9469d9-a4c4-4199-adbf-11dd0c962e5f None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.607881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 532/1067] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:03.612856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.613174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.613450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.631440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:03.632609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:03.639573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a15be190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.640305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.640515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.640780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.641641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:03.641943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.643382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.661941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 536/1068] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:03.667679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.706849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 533/1069] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:42:03.727313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.767147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765fafcc-ec9c-47e3-9e14-85cd6b63869d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.800893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a14fa250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.801734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.802012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.802281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.813614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.814787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.825474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7fc16-d59a-4450-8f02-dcd105a242f6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:42:03.834513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:03.841692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:03.842843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:42:03.842843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:42:03.842843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:03.842843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:03.842843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 537/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:03.845762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:03.860631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c343e2-e129-484a-a1a7-fece2d407eff None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f-lPMUpqRcGMIkBj2bH4ew, audit_chain_id=['f-lPMUpqRcGMIkBj2bH4ew']) at 0x7fe8a1202790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.861316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c343e2-e129-484a-a1a7-fece2d407eff None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.861597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c343e2-e129-484a-a1a7-fece2d407eff None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.861870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c343e2-e129-484a-a1a7-fece2d407eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.926084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c343e2-e129-484a-a1a7-fece2d407eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.927519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c343e2-e129-484a-a1a7-fece2d407eff None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.942406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdad86e-b057-4f9f-8484-fb059a89b91b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:03.975854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a1526490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:03.976517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.976799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.977103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.977821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:03.978125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:03.980099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f75e5c-6fdd-480c-9756-b85ef4bc6e84 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:03.991567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 538/1071] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:03.992808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8c618-c7a8-4b2a-b290-cdc4fbfac9ef None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:03.993122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8c618-c7a8-4b2a-b290-cdc4fbfac9ef None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:03.993391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8c618-c7a8-4b2a-b290-cdc4fbfac9ef None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:03.995630 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 539/1072] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:03.997810 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8c618-c7a8-4b2a-b290-cdc4fbfac9ef None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.024247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 534/1073] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 12:42:04.025572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.025857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.026558 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.045661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:04.046859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:04.103295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8c618-c7a8-4b2a-b290-cdc4fbfac9ef None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.122918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 535/1074] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:04.123762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.139419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a14e12e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.140212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.140489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.140756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.147684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.149159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:42:04.163062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:04.164132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 540/1075] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:04.165360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.220008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f0fbb8-25a3-4382-a48f-250ed1f09f2c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.254004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f-lPMUpqRcGMIkBj2bH4ew, audit_chain_id=['f-lPMUpqRcGMIkBj2bH4ew']) at 0x7fe8a1c5ccd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.254714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.254992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.255259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.265885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.267086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f35d3-eab2-4766-a8fc-c086d3fab68f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.267312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:42:04.284114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:04.285248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:04.286196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:42:04.286196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:42:04.286196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:04.286196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:04.286196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 536/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:04.286473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.304878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dlue2xZGS5SeQeSkDSAGJQ, audit_chain_id=['Dlue2xZGS5SeQeSkDSAGJQ']) at 0x7fe8a151d880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.305829 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.306153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.306468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.318538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:04.327021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:04.327974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 541/1077] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:04.329478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.398231 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab700e-52e4-4b65-9428-b9ef5c7f7681 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.429937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3426da-c7b1-4dcb-9958-251887105e4c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.436561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a14fb1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.437250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.437533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.437805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.438592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:04.438898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.440310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.451669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 537/1078] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:04.452464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.467376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=f-lPMUpqRcGMIkBj2bH4ew, audit_chain_id=['f-lPMUpqRcGMIkBj2bH4ew']) at 0x7fe8a14dc100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.468032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.468306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.468575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.469316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:04.469615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.470963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.483122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 542/1079] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:04.483866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.566566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51055383-bbbe-40ad-9be0-820c8401d1f5 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.599490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e35ea-f4c2-4713-8de4-478b8394e5f8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.606749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dlue2xZGS5SeQeSkDSAGJQ, audit_chain_id=['Dlue2xZGS5SeQeSkDSAGJQ']) at 0x7fe8a15564f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.607455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.607716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.607992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.608762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:04.609102 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.610507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.621313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 538/1080] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:04.627505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.641906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wc2p7iAWS4mTbkeQaCsw3w, audit_chain_id=['wc2p7iAWS4mTbkeQaCsw3w']) at 0x7fe8a151d5e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.642863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.643098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.643367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/97df92a4d0e543f79e611b9bfd03e1c3/roles/b4e1ef2657e740fd94ebd133a0ae3d17` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.646484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=97df92a4d0e543f79e611b9bfd03e1c3, role_id=b4e1ef2657e740fd94ebd133a0ae3d17)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.647971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.673012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 543/1081] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:42:04 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/97df92a4d0e543f79e611b9bfd03e1c3/roles/b4e1ef2657e740fd94ebd133a0ae3d17 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:42:04.746688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876099-04eb-4a31-8228-b156cdcec2de None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.793082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dlue2xZGS5SeQeSkDSAGJQ, audit_chain_id=['Dlue2xZGS5SeQeSkDSAGJQ']) at 0x7fe8a15f65b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.794332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.794791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.795065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] PATH_INFO: `/v3/users/09ff89503410441c9625caba3365657d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.796414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] RBAC: Authorizing `identity:get_user(user_id=09ff89503410441c9625caba3365657d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.797890 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.799589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 539/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/users/09ff89503410441c9625caba3365657d => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:04.806076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:04.914663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a494e-7554-45b3-8789-5e67c1b5d7f9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:04.947415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e29998-21f6-455e-ba92-dba39c2bc50a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dlue2xZGS5SeQeSkDSAGJQ, audit_chain_id=['Dlue2xZGS5SeQeSkDSAGJQ']) at 0x7fe8a14e2e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:04.948914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e29998-21f6-455e-ba92-dba39c2bc50a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:04.949219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e29998-21f6-455e-ba92-dba39c2bc50a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:04.949491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e29998-21f6-455e-ba92-dba39c2bc50a None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:04.950671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e29998-21f6-455e-ba92-dba39c2bc50a None admin] RBAC: Authorizing `identity:get_project(project_id=6a7cb6c0dbcc41698be4551a67c65e16)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:04.952094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e29998-21f6-455e-ba92-dba39c2bc50a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:04.953832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 544/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:04 2022] GET /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:04.959580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:05.061198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adacde88-d549-413d-a591-f25b60e6c402 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:05.097575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff2bd56-c5b2-4718-abff-405970f6165f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Dlue2xZGS5SeQeSkDSAGJQ, audit_chain_id=['Dlue2xZGS5SeQeSkDSAGJQ']) at 0x7fe8a15ff460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:05.098463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2bd56-c5b2-4718-abff-405970f6165f None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:05.098744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2bd56-c5b2-4718-abff-405970f6165f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:05.099017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff2bd56-c5b2-4718-abff-405970f6165f None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16/users/09ff89503410441c9625caba3365657d/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:05.100969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2bd56-c5b2-4718-abff-405970f6165f None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7cb6c0dbcc41698be4551a67c65e16, user_id=09ff89503410441c9625caba3365657d, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:05.102491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff2bd56-c5b2-4718-abff-405970f6165f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:05.115769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 540/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:42:04 2022] PUT /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16/users/09ff89503410441c9625caba3365657d/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:42:06.969335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec189191-3b32-48e4-a696-bb6f24094ad6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:06.969861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec189191-3b32-48e4-a696-bb6f24094ad6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:06.970051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec189191-3b32-48e4-a696-bb6f24094ad6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:06.973118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 545/1085] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:06.978418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:06.978826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:06.978960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:06.995741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:06.996913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:07.061796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 541/1086] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:07.085498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec189191-3b32-48e4-a696-bb6f24094ad6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.186004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec189191-3b32-48e4-a696-bb6f24094ad6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.222227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a14fb520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.222993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.223272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.223543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.235450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:07.243571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:07.244625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:07.245817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 546/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:07.251118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.347118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236d2f7-e2cd-42e6-8645-777eb2d5c4de None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.381688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a155a520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.382392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.382650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.382901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.383619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:07.383918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:07.385297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16dbfeb-4afa-4f92-86b6-99989f541989 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:07.394049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 542/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:07.399618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.402983 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee94a9-ba6a-4fad-87c8-db1f1cc1c0f3 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.403272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee94a9-ba6a-4fad-87c8-db1f1cc1c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.403546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ee94a9-ba6a-4fad-87c8-db1f1cc1c0f3 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.404855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 543/1089] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:42:07.409815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.410094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.410359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.426790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:07.427959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:07.492044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 544/1090] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:42:07.496080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff414c-1ce7-4d68-bfd0-a85b5145da05 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.516357 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.528560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a1525580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.529363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.529642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.529906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.540110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:07.541580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:42:07.558424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:07.559513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:07.560721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:42:07.560721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:42:07.560721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:07.560721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:07.560721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 547/1091] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:07.565284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.617484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ca7a-5c8b-47e6-a95f-3a741e9aa07c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.653290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=y33yF0_KQ3qJP401dQLypQ, audit_chain_id=['y33yF0_KQ3qJP401dQLypQ']) at 0x7fe8a15867f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.654080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.654362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.654637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.660834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d49215-d774-462c-8e1c-276d4877395f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.664590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:07.672254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:07.673441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:07.674408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 545/1092] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:07.679364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.695675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a1512dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.696442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.696718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.697005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.697718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:07.698567 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:07.700111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:07.711358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 548/1093] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:07.717447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.776946 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fb07-6201-49bd-8446-b66c4fb36483 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.809396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=y33yF0_KQ3qJP401dQLypQ, audit_chain_id=['y33yF0_KQ3qJP401dQLypQ']) at 0x7fe8a14cb250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.810058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.810342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.810616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.811359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:07.811664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:07.812328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d935ac85-ac12-4de4-8e1a-b3fe42f40d68 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.813061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:07.820949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 546/1094] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:07.826628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.845641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a157cbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.846425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.846699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.846966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.853795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:07.855893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:42:07.870679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:07.871981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 549/1095] 10.222.0.49 () {56 vars in 1093 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:07.878193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.930243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9207-038b-47ee-adb6-333002596139 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:07.962734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=y33yF0_KQ3qJP401dQLypQ, audit_chain_id=['y33yF0_KQ3qJP401dQLypQ']) at 0x7fe8a1556bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:07.963668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:07.964299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:07.964299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] PATH_INFO: `/v3/users/09ff89503410441c9625caba3365657d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:07.965427 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] RBAC: Authorizing `identity:get_user(user_id=09ff89503410441c9625caba3365657d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:07.966858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:07.968512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 547/1096] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/users/09ff89503410441c9625caba3365657d => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:07.973978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:07.985795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f0844-98f9-44ca-9766-78d23dddca34 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.020013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a138f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.020673 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.020951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.021258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.022079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:08.022381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.023795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.040304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 550/1097] 10.222.0.49 () {56 vars in 1133 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:08.046800 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.071407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3db2c4-9310-4662-9280-de4914596a6e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.105588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=y33yF0_KQ3qJP401dQLypQ, audit_chain_id=['y33yF0_KQ3qJP401dQLypQ']) at 0x7fe8a15dffd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.106233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.106516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.106789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.142368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796b648-aa3b-4725-99da-cca3cc3b2067 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.178568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.179929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.185496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a15687c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.186146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.186425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.186696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.251067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.252500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.275781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 548/1098] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:08.282183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.352612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 551/1099] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 13 12:42:08.353583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.375247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb1260-6a97-4be1-a619-272441b6c953 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.408155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=y33yF0_KQ3qJP401dQLypQ, audit_chain_id=['y33yF0_KQ3qJP401dQLypQ']) at 0x7fe8a160ef10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.409018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.409298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.409586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.410800 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7cb6c0dbcc41698be4551a67c65e16)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.412222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.413933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 549/1100] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:08.420452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.454950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e1cd87-5ab7-4681-b11f-6cd9d546e00b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.488818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a149e3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.489634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.489912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.490180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.500123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.501639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.519627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afdc7ad-0019-4d61-9dda-efad8af552f3 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:42:08.520146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:08.521186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:08.522187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:42:08.522187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:42:08.522187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:42:08.522187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:08.522187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 552/1101] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:08.527645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.554823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=y33yF0_KQ3qJP401dQLypQ, audit_chain_id=['y33yF0_KQ3qJP401dQLypQ']) at 0x7fe8a1581bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.555539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.555814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.556082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.556902 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16, user.id=09ff89503410441c9625caba3365657d) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:08.557237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.558845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.565344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 550/1102] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/role_assignments?user.id=09ff89503410441c9625caba3365657d&scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:08.628612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f2ddd-498e-434d-a67f-ca0c2b97250d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.665263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a151de20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.665941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.666218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.666489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.667217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:08.667520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.669052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.681300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 553/1103] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:08.687169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.797967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d69198e-e8b5-43f1-99c0-0a3792ced74d None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.830500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a15ff430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.831317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.831596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.831868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.838445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.840607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:42:08.854613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:08.855521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:08.856456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 551/1104] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:08.861741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:08.959006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b839d7e-bf62-4dcd-bbe8-18152677d561 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:08.994061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a14f05e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:08.995326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:08.995484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:08.995766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:08.996553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:08.996854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:08.998321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a3e5c-c801-472d-a112-98332ce638a5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:09.010323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 554/1105] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:42:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:09.018027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:09.118002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4186fc56-e95f-466a-9ab8-a5325e1584bd None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:09.152136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QrAByvNSR9icAdEGiwm2ow, audit_chain_id=['QrAByvNSR9icAdEGiwm2ow']) at 0x7fe8a14e46a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:09.152787 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:09.153099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:09.153376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:09.154201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] RBAC: Adding query filter params (role.id=b4e1ef2657e740fd94ebd133a0ae3d17, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=97df92a4d0e543f79e611b9bfd03e1c3) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:09.154511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:09.155935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cf1d9-698e-4b2e-b0ba-46e620b3be75 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:09.161860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 552/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:09 2022] GET /identity/v3/role_assignments?user.id=97df92a4d0e543f79e611b9bfd03e1c3&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b4e1ef2657e740fd94ebd133a0ae3d17 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:10.864051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee888e-ba0d-468b-a200-9fa3e25a7c61 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:10.864585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee888e-ba0d-468b-a200-9fa3e25a7c61 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:10.864585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ee888e-ba0d-468b-a200-9fa3e25a7c61 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:10.865991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 555/1107] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:10.871118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:10.872051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:10.872261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:10.888873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:10.890065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:10.954703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 553/1108] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:10.980168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee888e-ba0d-468b-a200-9fa3e25a7c61 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:11.076955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ee888e-ba0d-468b-a200-9fa3e25a7c61 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:11.110986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9048a-0b1a-4354-9b06-89a0ee37b16f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WK6nXiaXSnyvSSyNXlarSw, audit_chain_id=['WK6nXiaXSnyvSSyNXlarSw']) at 0x7fe8a133cc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:11.111901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9048a-0b1a-4354-9b06-89a0ee37b16f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:11.112231 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9048a-0b1a-4354-9b06-89a0ee37b16f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:11.112528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9048a-0b1a-4354-9b06-89a0ee37b16f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:11.113955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9048a-0b1a-4354-9b06-89a0ee37b16f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:11.115617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9048a-0b1a-4354-9b06-89a0ee37b16f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:11.117463 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 556/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:11.123515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:11.221191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b554c3-84f7-43b8-93e8-c8cb0578fdf9 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:11.254173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd675a-3cf6-4307-af5c-4a1ec4e21cf4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=WK6nXiaXSnyvSSyNXlarSw, audit_chain_id=['WK6nXiaXSnyvSSyNXlarSw']) at 0x7fe8a1829460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:11.254842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd675a-3cf6-4307-af5c-4a1ec4e21cf4 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:11.255125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd675a-3cf6-4307-af5c-4a1ec4e21cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:11.255400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd675a-3cf6-4307-af5c-4a1ec4e21cf4 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:11.256114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd675a-3cf6-4307-af5c-4a1ec4e21cf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:11.257647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd675a-3cf6-4307-af5c-4a1ec4e21cf4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:11.277576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 554/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:42:11 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:42:13.551210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194f4d0-6b01-4157-b9b8-9346c4aded46 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:13.551746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194f4d0-6b01-4157-b9b8-9346c4aded46 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:13.551834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194f4d0-6b01-4157-b9b8-9346c4aded46 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:13.553222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 557/1111] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:13.558569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:13.559007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:13.559109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:13.575525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:13.576696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:13.640715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 555/1112] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:13.663987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194f4d0-6b01-4157-b9b8-9346c4aded46 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:13.763015 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194f4d0-6b01-4157-b9b8-9346c4aded46 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:13.796022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MJdtZHdfQKOXRRBFlLFpFg, audit_chain_id=['MJdtZHdfQKOXRRBFlLFpFg']) at 0x7fe8a14dcc40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:13.796838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:13.797148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:13.797420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] PATH_INFO: `/v3/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:13.798878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] RBAC: Authorizing `identity:get_role(role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:13.800232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:13.801665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 558/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:13 2022] GET /identity/v3/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:13.807612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:13.902858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9851f2a-8e32-478c-94dd-bced5b2209de None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:13.935201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MJdtZHdfQKOXRRBFlLFpFg, audit_chain_id=['MJdtZHdfQKOXRRBFlLFpFg']) at 0x7fe8a1528640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:13.936042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:13.936316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:13.936583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] PATH_INFO: `/v3/users/311a7f41a4554ea5b6419cd75b16771b` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:13.949326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] RBAC: Authorizing `identity:get_user(user_id=311a7f41a4554ea5b6419cd75b16771b)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:13.950756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:13.952358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 556/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:13 2022] GET /identity/v3/users/311a7f41a4554ea5b6419cd75b16771b => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:13.958041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:14.053648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03a788-47cf-4b49-ace4-6f14b5b52a43 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:14.085966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MJdtZHdfQKOXRRBFlLFpFg, audit_chain_id=['MJdtZHdfQKOXRRBFlLFpFg']) at 0x7fe8a14fae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:14.086604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:14.086880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:14.087144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:14.155339 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:14.156778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:14.250669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 559/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:14.256654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:14.356729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23075f1d-38c9-444b-b7c9-c7a1e3903365 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:14.389168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e8e01-4fd9-40ba-bb4a-8653e862967f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MJdtZHdfQKOXRRBFlLFpFg, audit_chain_id=['MJdtZHdfQKOXRRBFlLFpFg']) at 0x7fe8a160ccd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:14.390001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8e01-4fd9-40ba-bb4a-8653e862967f None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:14.390275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8e01-4fd9-40ba-bb4a-8653e862967f None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:14.390546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e8e01-4fd9-40ba-bb4a-8653e862967f None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:14.391698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e8e01-4fd9-40ba-bb4a-8653e862967f None admin] RBAC: Authorizing `identity:get_project(project_id=6a7cb6c0dbcc41698be4551a67c65e16)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:14.393136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e8e01-4fd9-40ba-bb4a-8653e862967f None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:14.394790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 557/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:14 2022] GET /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:14.400883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:14.492833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ac2fab-b721-4f5f-bd2d-1ffb110fe953 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:14.524835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MJdtZHdfQKOXRRBFlLFpFg, audit_chain_id=['MJdtZHdfQKOXRRBFlLFpFg']) at 0x7fe8a14f3430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:14.525495 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:14.525766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:14.526065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:14.526874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] RBAC: Adding query filter params (role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16, user.id=311a7f41a4554ea5b6419cd75b16771b) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:14.527176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:14.528585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af55e6b6-6ccd-4317-8fc9-aa2c7c622cbe None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:14.534429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 560/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:14 2022] GET /identity/v3/role_assignments?user.id=311a7f41a4554ea5b6419cd75b16771b&scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:16.734201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4033-7cb1-430b-8c5f-5440f9b59653 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:16.734768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4033-7cb1-430b-8c5f-5440f9b59653 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:16.734768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb4033-7cb1-430b-8c5f-5440f9b59653 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:16.736135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 558/1118] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:16.741188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:16.741562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:16.741731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:16.757789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:16.758961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:16.821394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 561/1119] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:16.844536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb4033-7cb1-430b-8c5f-5440f9b59653 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:16.945809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb4033-7cb1-430b-8c5f-5440f9b59653 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:16.980533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9cjH45sRSyee6TJqxdrcA, audit_chain_id=['H9cjH45sRSyee6TJqxdrcA']) at 0x7fe8a160ed30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:16.981416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:16.981694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:16.981962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] PATH_INFO: `/v3/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:16.983409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] RBAC: Authorizing `identity:get_role(role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:16.984808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:16.986191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 559/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:16 2022] GET /identity/v3/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:16.991905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:17.085654 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c174344-a646-42e1-b28b-f3520587ac7f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:17.118440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9cjH45sRSyee6TJqxdrcA, audit_chain_id=['H9cjH45sRSyee6TJqxdrcA']) at 0x7fe8a14f39d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:17.119292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:17.119563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:17.120370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] PATH_INFO: `/v3/users/311a7f41a4554ea5b6419cd75b16771b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:17.121756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] RBAC: Authorizing `identity:get_user(user_id=311a7f41a4554ea5b6419cd75b16771b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:17.123171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:17.124776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 562/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:16 2022] GET /identity/v3/users/311a7f41a4554ea5b6419cd75b16771b => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:17.130518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:17.226076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47899e4-f599-4ebb-94b4-0db3abada911 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:17.257783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8af00-f3e6-42b7-b0a5-13cdee946187 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9cjH45sRSyee6TJqxdrcA, audit_chain_id=['H9cjH45sRSyee6TJqxdrcA']) at 0x7fe8a12026a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:17.258555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8af00-f3e6-42b7-b0a5-13cdee946187 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:17.258912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8af00-f3e6-42b7-b0a5-13cdee946187 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:17.259183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8af00-f3e6-42b7-b0a5-13cdee946187 None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:17.260336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8af00-f3e6-42b7-b0a5-13cdee946187 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7cb6c0dbcc41698be4551a67c65e16)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:17.262551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8af00-f3e6-42b7-b0a5-13cdee946187 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:17.264465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 560/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:17 2022] GET /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:17.270790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:17.365603 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dc4083-8b78-4b19-9803-eed86ec1ddfa None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:17.398861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b851ac5-75ef-49c0-a4e0-ff933cd1041a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H9cjH45sRSyee6TJqxdrcA, audit_chain_id=['H9cjH45sRSyee6TJqxdrcA']) at 0x7fe8a1501160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:17.399733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b851ac5-75ef-49c0-a4e0-ff933cd1041a None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:17.400013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b851ac5-75ef-49c0-a4e0-ff933cd1041a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:17.400286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b851ac5-75ef-49c0-a4e0-ff933cd1041a None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16/users/311a7f41a4554ea5b6419cd75b16771b/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:17.402537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b851ac5-75ef-49c0-a4e0-ff933cd1041a None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7cb6c0dbcc41698be4551a67c65e16, user_id=311a7f41a4554ea5b6419cd75b16771b, role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:17.403954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b851ac5-75ef-49c0-a4e0-ff933cd1041a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:17.416028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 563/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:42:17 2022] PUT /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16/users/311a7f41a4554ea5b6419cd75b16771b/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:42:19.608093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe98b1-c5de-4771-9cf4-5f9f7413a097 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:19.608658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe98b1-c5de-4771-9cf4-5f9f7413a097 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:19.608658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe98b1-c5de-4771-9cf4-5f9f7413a097 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:19.610016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 561/1124] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:19.615295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:19.615716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:19.615823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:19.631897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:19.633080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:19.702980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 564/1125] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:19.727621 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe98b1-c5de-4771-9cf4-5f9f7413a097 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:19.825094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe98b1-c5de-4771-9cf4-5f9f7413a097 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:19.856863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LT70VxkoQC6guGaH8uTwBA, audit_chain_id=['LT70VxkoQC6guGaH8uTwBA']) at 0x7fe8a1812040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:19.857723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:19.858001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:19.858314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] PATH_INFO: `/v3/roles/659e4e7a2fa4411ebcf80a83e35e9cbb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:19.859722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] RBAC: Authorizing `identity:get_role(role_id=659e4e7a2fa4411ebcf80a83e35e9cbb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:19.861096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:19.862448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 562/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:19 2022] GET /identity/v3/roles/659e4e7a2fa4411ebcf80a83e35e9cbb => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:19.868573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:19.973982 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b98cbe-edba-4612-aae3-9574859ebdb3 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:20.006855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LT70VxkoQC6guGaH8uTwBA, audit_chain_id=['LT70VxkoQC6guGaH8uTwBA']) at 0x7fe8a15687c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:20.007703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:20.007979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:20.008248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] PATH_INFO: `/v3/users/311a7f41a4554ea5b6419cd75b16771b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:20.009433 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] RBAC: Authorizing `identity:get_user(user_id=311a7f41a4554ea5b6419cd75b16771b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:20.011221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:20.012836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 565/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:19 2022] GET /identity/v3/users/311a7f41a4554ea5b6419cd75b16771b => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:42:20.018937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:20.118320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97acd73-84ec-4282-b94f-4de5d34cbb4e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:20.150169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LT70VxkoQC6guGaH8uTwBA, audit_chain_id=['LT70VxkoQC6guGaH8uTwBA']) at 0x7fe8a15dfc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:20.150849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:20.151661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:20.152047 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:20.228502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:20.230139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:20.334209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 563/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:20.340683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:20.435641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf27419-b710-4e7a-95bb-cb76e5bbdda0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:20.469195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c18ce32-a289-41bb-b6fc-e4cfc036681e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LT70VxkoQC6guGaH8uTwBA, audit_chain_id=['LT70VxkoQC6guGaH8uTwBA']) at 0x7fe8a15073a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:20.470067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ce32-a289-41bb-b6fc-e4cfc036681e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:20.470364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ce32-a289-41bb-b6fc-e4cfc036681e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:20.470659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c18ce32-a289-41bb-b6fc-e4cfc036681e None admin] PATH_INFO: `/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:20.471895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ce32-a289-41bb-b6fc-e4cfc036681e None admin] RBAC: Authorizing `identity:get_project(project_id=6a7cb6c0dbcc41698be4551a67c65e16)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:20.473413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c18ce32-a289-41bb-b6fc-e4cfc036681e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:20.475198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 566/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:20 2022] GET /identity/v3/projects/6a7cb6c0dbcc41698be4551a67c65e16 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:20.481879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:20.588516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d2ac-f007-460e-9be2-2cc0e5eb8b7e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:20.620438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=LT70VxkoQC6guGaH8uTwBA, audit_chain_id=['LT70VxkoQC6guGaH8uTwBA']) at 0x7fe8a1c5cbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:20.621095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:20.621374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:20.621642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:20.622452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] RBAC: Adding query filter params (role.id=659e4e7a2fa4411ebcf80a83e35e9cbb, scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16, user.id=311a7f41a4554ea5b6419cd75b16771b) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:20.622757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:20.624165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99af664f-bad3-4ac4-8f7b-ceffc428fb89 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:20.629857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 564/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:20 2022] GET /identity/v3/role_assignments?user.id=311a7f41a4554ea5b6419cd75b16771b&scope.project.id=6a7cb6c0dbcc41698be4551a67c65e16&role.id=659e4e7a2fa4411ebcf80a83e35e9cbb => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:22.882083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e0fb-9d1d-4a5a-b19c-f55465cd16ce None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:22.882642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e0fb-9d1d-4a5a-b19c-f55465cd16ce None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:22.882642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5e0fb-9d1d-4a5a-b19c-f55465cd16ce None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:22.883964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 567/1131] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:22.889677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:22.890109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:22.890218 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:22.906539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:22.907694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:22.973132 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 565/1132] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:23.000966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5e0fb-9d1d-4a5a-b19c-f55465cd16ce None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:23.101832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5e0fb-9d1d-4a5a-b19c-f55465cd16ce None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:23.133728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258126b-f78c-419a-9ec4-ad6fa6678813 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=koiTYlDrTTKZqinhS88lRw, audit_chain_id=['koiTYlDrTTKZqinhS88lRw']) at 0x7fe8a1532850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:23.134424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258126b-f78c-419a-9ec4-ad6fa6678813 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:23.134698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258126b-f78c-419a-9ec4-ad6fa6678813 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:23.134964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258126b-f78c-419a-9ec4-ad6fa6678813 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:23.136752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258126b-f78c-419a-9ec4-ad6fa6678813 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:23.138201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258126b-f78c-419a-9ec4-ad6fa6678813 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:23.140065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 568/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:23.145863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:23.243184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233bf8f-cd2d-4704-8022-1330a17078b6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:23.279762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66073844-65d9-4122-b66e-323871bc097d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=koiTYlDrTTKZqinhS88lRw, audit_chain_id=['koiTYlDrTTKZqinhS88lRw']) at 0x7fe8a1579a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:23.280432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073844-65d9-4122-b66e-323871bc097d None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:23.280735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073844-65d9-4122-b66e-323871bc097d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:23.281061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66073844-65d9-4122-b66e-323871bc097d None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:23.281801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073844-65d9-4122-b66e-323871bc097d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:23.283216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66073844-65d9-4122-b66e-323871bc097d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:23.306979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 566/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:42:23 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:42:25.587907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16fac-3b10-4093-ab3d-15e98bbeb650 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:25.588448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16fac-3b10-4093-ab3d-15e98bbeb650 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:25.588448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f16fac-3b10-4093-ab3d-15e98bbeb650 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:25.590017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 569/1135] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:25.595365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:25.595758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:25.595927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:25.612428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:25.613665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:25.686592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 567/1136] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:25.712780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16fac-3b10-4093-ab3d-15e98bbeb650 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:25.814245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f16fac-3b10-4093-ab3d-15e98bbeb650 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:25.847375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4919222-5412-4450-bf2d-95f9a2847ccf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ECAUStPQTsSexVSciEGxKg, audit_chain_id=['ECAUStPQTsSexVSciEGxKg']) at 0x7fe8a18b3160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:25.848083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4919222-5412-4450-bf2d-95f9a2847ccf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:25.848367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4919222-5412-4450-bf2d-95f9a2847ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:25.848643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4919222-5412-4450-bf2d-95f9a2847ccf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:25.849836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4919222-5412-4450-bf2d-95f9a2847ccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:25.851262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4919222-5412-4450-bf2d-95f9a2847ccf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:25.852879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 570/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:25.859126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:25.951920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0afcf5d-214a-4d8f-b4ac-f18df37108ba None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:25.984846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93b950-b1f4-418b-9fe9-62a8e9696bad None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ECAUStPQTsSexVSciEGxKg, audit_chain_id=['ECAUStPQTsSexVSciEGxKg']) at 0x7fe8a160e1c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:25.985549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b950-b1f4-418b-9fe9-62a8e9696bad None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:25.985827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b950-b1f4-418b-9fe9-62a8e9696bad None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:25.986089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93b950-b1f4-418b-9fe9-62a8e9696bad None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:25.986785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b950-b1f4-418b-9fe9-62a8e9696bad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:25.988210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93b950-b1f4-418b-9fe9-62a8e9696bad None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:26.013086 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 568/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:42:25 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:42:28.301892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182147f-04c9-4ccd-9932-84eddd8028f7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:28.302442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182147f-04c9-4ccd-9932-84eddd8028f7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:28.302442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182147f-04c9-4ccd-9932-84eddd8028f7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:28.303708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 571/1139] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:28.310041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:28.310523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:28.310622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:28.327474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:28.328647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:28.393529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 569/1140] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:42:28.417519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182147f-04c9-4ccd-9932-84eddd8028f7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:28.514577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182147f-04c9-4ccd-9932-84eddd8028f7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:28.547425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kJTp85OZQDSleh_T-yWvcw, audit_chain_id=['kJTp85OZQDSleh_T-yWvcw']) at 0x7fe8a14f3b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:28.548195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:28.548474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:28.548749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:28.558708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:28.566102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:28.567292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:28.568461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 572/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:28.573341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:28.671934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb1c2ba-b281-45e3-9948-0fb3a8387e67 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:28.704160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kJTp85OZQDSleh_T-yWvcw, audit_chain_id=['kJTp85OZQDSleh_T-yWvcw']) at 0x7fe8a25226d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:28.704892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:28.705201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:28.705481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:28.706302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:28.706647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:28.708159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:28.717199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 570/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:28.722873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:28.818380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6841e-27dc-4ea5-8e80-dea8f3d63cf6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:28.850755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kJTp85OZQDSleh_T-yWvcw, audit_chain_id=['kJTp85OZQDSleh_T-yWvcw']) at 0x7fe8a1525e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:28.851599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:28.851873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:28.852139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] PATH_INFO: `/v3/users/2f4906d2ae124e5094b3ca358731cad4` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:28.865151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] RBAC: Authorizing `identity:get_user(user_id=2f4906d2ae124e5094b3ca358731cad4)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:28.866587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:28.868235 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 573/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:28 2022] GET /identity/v3/users/2f4906d2ae124e5094b3ca358731cad4 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:28.874054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:28.971188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb7fdc-73db-4cac-a649-abaf46dd9e8c None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:29.004095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kJTp85OZQDSleh_T-yWvcw, audit_chain_id=['kJTp85OZQDSleh_T-yWvcw']) at 0x7fe8a160eb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:29.004741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:29.005049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:29.005328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:29.070459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:29.071827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:29.173184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 571/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:29.179596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:29.275412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c6a38-7f5d-4f09-b598-c39849b6486e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:29.306837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eaa99-8c66-4ae0-887b-c4d2a3ec70c5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kJTp85OZQDSleh_T-yWvcw, audit_chain_id=['kJTp85OZQDSleh_T-yWvcw']) at 0x7fe8a1512c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:29.308234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eaa99-8c66-4ae0-887b-c4d2a3ec70c5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:29.308509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eaa99-8c66-4ae0-887b-c4d2a3ec70c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:29.308774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eaa99-8c66-4ae0-887b-c4d2a3ec70c5 None admin] PATH_INFO: `/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:29.309997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eaa99-8c66-4ae0-887b-c4d2a3ec70c5 None admin] RBAC: Authorizing `identity:get_project(project_id=85a6e22fe3984cc4bb89b19b25f9b5bb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:29.311454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eaa99-8c66-4ae0-887b-c4d2a3ec70c5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:29.313193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 574/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:29 2022] GET /identity/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:29.319282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:29.415466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e4633-f7fa-42c8-ba57-d963bb36db75 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:29.452916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=kJTp85OZQDSleh_T-yWvcw, audit_chain_id=['kJTp85OZQDSleh_T-yWvcw']) at 0x7fe8a1812130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:29.453587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:29.453862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:29.454130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:29.454942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=85a6e22fe3984cc4bb89b19b25f9b5bb, user.id=2f4906d2ae124e5094b3ca358731cad4) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:29.455246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:29.456661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514f715-9f89-4239-8d92-99a19c5c7c92 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:29.461935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 572/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:29 2022] GET /identity/v3/role_assignments?user.id=2f4906d2ae124e5094b3ca358731cad4&scope.project.id=85a6e22fe3984cc4bb89b19b25f9b5bb&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:31.690002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccf0a2-fc92-4587-b8da-51df7b253a25 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:31.690555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccf0a2-fc92-4587-b8da-51df7b253a25 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:31.690555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccf0a2-fc92-4587-b8da-51df7b253a25 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:31.691885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 575/1147] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:31.696959 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:31.697414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:31.697535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:31.715024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:31.716178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:31.779557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 573/1148] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:31.801655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccf0a2-fc92-4587-b8da-51df7b253a25 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:31.899912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ccf0a2-fc92-4587-b8da-51df7b253a25 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:31.932780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yHWpbGa-R1GZNPdWaoE77A, audit_chain_id=['yHWpbGa-R1GZNPdWaoE77A']) at 0x7fe8a1568430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:31.933577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:31.933854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:31.934123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:31.943812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:31.951996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:31.953134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:31.954045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 576/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:31.959450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:32.056199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666f5c6-cc23-4df5-bce2-cb414ed28fe3 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:32.088302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yHWpbGa-R1GZNPdWaoE77A, audit_chain_id=['yHWpbGa-R1GZNPdWaoE77A']) at 0x7fe8a1528640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:32.089727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:32.090010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:32.090283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:32.091026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:32.091331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:32.092742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:32.101031 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 574/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:32.107092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:32.206836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc57007-9ccc-4907-9db6-92fcdf26630e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:32.239394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yHWpbGa-R1GZNPdWaoE77A, audit_chain_id=['yHWpbGa-R1GZNPdWaoE77A']) at 0x7fe8a1429d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:32.240244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:32.240634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:32.240903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] PATH_INFO: `/v3/users/2f4906d2ae124e5094b3ca358731cad4` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:32.242113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] RBAC: Authorizing `identity:get_user(user_id=2f4906d2ae124e5094b3ca358731cad4)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:32.243535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:32.245803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 577/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:32 2022] GET /identity/v3/users/2f4906d2ae124e5094b3ca358731cad4 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:32.251768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:32.348660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf480dc-ebd2-44e1-bbc5-a8c867fe58aa None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:32.381600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aac6e0-ed54-4121-98d7-b0e43d0973e2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yHWpbGa-R1GZNPdWaoE77A, audit_chain_id=['yHWpbGa-R1GZNPdWaoE77A']) at 0x7fe8a1579d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:32.382437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac6e0-ed54-4121-98d7-b0e43d0973e2 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:32.382720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac6e0-ed54-4121-98d7-b0e43d0973e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:32.382993 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aac6e0-ed54-4121-98d7-b0e43d0973e2 None admin] PATH_INFO: `/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:32.384222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aac6e0-ed54-4121-98d7-b0e43d0973e2 None admin] RBAC: Authorizing `identity:get_project(project_id=85a6e22fe3984cc4bb89b19b25f9b5bb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:32.386392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aac6e0-ed54-4121-98d7-b0e43d0973e2 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:32.388071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 575/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:32 2022] GET /identity/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:32.394203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:32.490777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3854cdf-ecaa-4a77-89e5-8f61ecaf4d8a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:32.523436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241fa214-147d-437b-a17f-bf13ee57c84c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yHWpbGa-R1GZNPdWaoE77A, audit_chain_id=['yHWpbGa-R1GZNPdWaoE77A']) at 0x7fe8a15be190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:32.524304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa214-147d-437b-a17f-bf13ee57c84c None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:32.524584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa214-147d-437b-a17f-bf13ee57c84c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:32.524857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241fa214-147d-437b-a17f-bf13ee57c84c None admin] PATH_INFO: `/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb/users/2f4906d2ae124e5094b3ca358731cad4/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:32.526843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa214-147d-437b-a17f-bf13ee57c84c None admin] RBAC: Authorizing `identity:create_grant(project_id=85a6e22fe3984cc4bb89b19b25f9b5bb, user_id=2f4906d2ae124e5094b3ca358731cad4, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:32.528264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241fa214-147d-437b-a17f-bf13ee57c84c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:32.540461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 578/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:42:32 2022] PUT /identity/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb/users/2f4906d2ae124e5094b3ca358731cad4/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:42:34.775724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59c5f-dc94-4dc4-aeba-5c1431efd43c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:34.776886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59c5f-dc94-4dc4-aeba-5c1431efd43c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:34.776886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e59c5f-dc94-4dc4-aeba-5c1431efd43c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:34.778215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 576/1154] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:34.783926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:34.784349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:34.784513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:34.801260 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:34.802540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:34.866205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 579/1155] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:34.890720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59c5f-dc94-4dc4-aeba-5c1431efd43c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:34.989262 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e59c5f-dc94-4dc4-aeba-5c1431efd43c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:35.021273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OpuCeVeeRoiBi5vP-OAYvg, audit_chain_id=['OpuCeVeeRoiBi5vP-OAYvg']) at 0x7fe8a25226d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:35.022042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:35.022317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:35.022585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:35.032810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:35.040111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:35.041241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:35.042326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 577/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:35.047384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:35.142897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74471f3-4f36-423b-a92b-69f19b9a64ed None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:35.174416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OpuCeVeeRoiBi5vP-OAYvg, audit_chain_id=['OpuCeVeeRoiBi5vP-OAYvg']) at 0x7fe8a1568430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:35.175066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:35.175340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:35.175617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:35.176335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:35.176632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:35.178016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:35.186490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 580/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:35.192249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:35.289658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96991f25-8c45-457e-9f60-12d8fad6ee87 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:35.321893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OpuCeVeeRoiBi5vP-OAYvg, audit_chain_id=['OpuCeVeeRoiBi5vP-OAYvg']) at 0x7fe8a14e47f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:35.322745 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:35.323693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:35.323997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] PATH_INFO: `/v3/users/2f4906d2ae124e5094b3ca358731cad4` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:35.325301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] RBAC: Authorizing `identity:get_user(user_id=2f4906d2ae124e5094b3ca358731cad4)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:35.326729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:35.328322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 578/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:35 2022] GET /identity/v3/users/2f4906d2ae124e5094b3ca358731cad4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:35.334090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:35.438354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413085ff-8998-4726-adf0-d46bf3626d22 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:35.471270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OpuCeVeeRoiBi5vP-OAYvg, audit_chain_id=['OpuCeVeeRoiBi5vP-OAYvg']) at 0x7fe8a14f0370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:35.471885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:35.472158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:35.472422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:35.535300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:35.536729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:35.629562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 581/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:35.635350 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:35.746071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fe024-4dc4-4751-b804-bf11b73a77b8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:35.778392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f575f3a8-bf35-41b1-b862-57cc068aef09 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OpuCeVeeRoiBi5vP-OAYvg, audit_chain_id=['OpuCeVeeRoiBi5vP-OAYvg']) at 0x7fe8a1573520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:35.779232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f3a8-bf35-41b1-b862-57cc068aef09 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:35.779509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f3a8-bf35-41b1-b862-57cc068aef09 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:35.779775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575f3a8-bf35-41b1-b862-57cc068aef09 None admin] PATH_INFO: `/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:35.780927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575f3a8-bf35-41b1-b862-57cc068aef09 None admin] RBAC: Authorizing `identity:get_project(project_id=85a6e22fe3984cc4bb89b19b25f9b5bb)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:35.782359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f575f3a8-bf35-41b1-b862-57cc068aef09 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:35.784021 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 579/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:35 2022] GET /identity/v3/projects/85a6e22fe3984cc4bb89b19b25f9b5bb => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:35.790244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:35.885702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a99e8-2685-4769-9500-e72cb100bf49 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:35.919366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=OpuCeVeeRoiBi5vP-OAYvg, audit_chain_id=['OpuCeVeeRoiBi5vP-OAYvg']) at 0x7fe8a1568100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:35.920004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:35.920284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:35.920765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:35.921437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=85a6e22fe3984cc4bb89b19b25f9b5bb, user.id=2f4906d2ae124e5094b3ca358731cad4) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:35.921746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:35.923153 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eb2ae-042c-406c-afc0-9074117e8fc9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:35.928852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 582/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:35 2022] GET /identity/v3/role_assignments?user.id=2f4906d2ae124e5094b3ca358731cad4&scope.project.id=85a6e22fe3984cc4bb89b19b25f9b5bb&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:38.171958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6d5c6-27f0-4759-b3ff-ee0eefdbe9ad None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:38.172585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6d5c6-27f0-4759-b3ff-ee0eefdbe9ad None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:38.172585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6d5c6-27f0-4759-b3ff-ee0eefdbe9ad None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:38.173861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 580/1162] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:38.179022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:38.179460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:38.179571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:38.197591 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:38.199407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:38.264868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 583/1163] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:38.286632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6d5c6-27f0-4759-b3ff-ee0eefdbe9ad None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:38.386961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6d5c6-27f0-4759-b3ff-ee0eefdbe9ad None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:38.421166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Sc3qp0nWQhaixN12OHXd5Q, audit_chain_id=['Sc3qp0nWQhaixN12OHXd5Q']) at 0x7fe8a15f6d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:38.421800 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:38.422078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:38.422347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:38.486111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:38.487526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:38.581027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 581/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:38.586896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:38.679467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679acb08-e3e9-4258-a854-33b71dd2d5e1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:38.713269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Sc3qp0nWQhaixN12OHXd5Q, audit_chain_id=['Sc3qp0nWQhaixN12OHXd5Q']) at 0x7fe8a138f6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:38.714222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:38.714540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:38.714852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:38.721530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:38.723047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-d197d919-e7bf-42dc-865f-3ebc90b2dde5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:38.737702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:38.738991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:38.739891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 584/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:42:38 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:38.745631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:38.840501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680c6d2c-5312-42ea-8725-ff54debb436a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:38.873061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=Sc3qp0nWQhaixN12OHXd5Q, audit_chain_id=['Sc3qp0nWQhaixN12OHXd5Q']) at 0x7fe8a1c5ca90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:38.873732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:38.874008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:38.874283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:38.875056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:38.875352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:38.876759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9c7a10-6132-4fcd-8cfc-cf6e087d9338 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:38.883901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 582/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Fri May 13 12:42:38 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:41.110351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7a509-4371-46a6-9cee-8fef0931a9ee None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:41.110899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7a509-4371-46a6-9cee-8fef0931a9ee None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:41.110899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7a509-4371-46a6-9cee-8fef0931a9ee None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:41.112243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 585/1167] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:41.118249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43a88-63fa-477e-be96-567233587a84 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:41.118665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43a88-63fa-477e-be96-567233587a84 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:41.118803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb43a88-63fa-477e-be96-567233587a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:41.136367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-ccb43a88-63fa-477e-be96-567233587a84 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:41.137613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ccb43a88-63fa-477e-be96-567233587a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:41.205892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 583/1168] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:41.228584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7a509-4371-46a6-9cee-8fef0931a9ee None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:41.337884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7a509-4371-46a6-9cee-8fef0931a9ee None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:41.369299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64cd2d5-c029-4227-a3d6-4f5d6674e8bb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=1GknJgDpTCaSQMw3jqdQEg, audit_chain_id=['1GknJgDpTCaSQMw3jqdQEg']) at 0x7fe8a153ba30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:41.370507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd2d5-c029-4227-a3d6-4f5d6674e8bb None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:41.370766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd2d5-c029-4227-a3d6-4f5d6674e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:41.371146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64cd2d5-c029-4227-a3d6-4f5d6674e8bb None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:41.371878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd2d5-c029-4227-a3d6-4f5d6674e8bb None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:41.373262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64cd2d5-c029-4227-a3d6-4f5d6674e8bb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:41.388686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 586/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Fri May 13 12:42:41 2022] POST /identity/v3/domains => generated 267 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:42:43.673305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef54b9-6aa9-48a9-a4ea-edd9e449d74a None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:43.673886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef54b9-6aa9-48a9-a4ea-edd9e449d74a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:43.673886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef54b9-6aa9-48a9-a4ea-edd9e449d74a None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:43.675204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 584/1170] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:43.680717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:43.681166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:43.681281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:43.697472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:43.699187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:43.762352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 587/1171] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:43.786100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef54b9-6aa9-48a9-a4ea-edd9e449d74a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:43.889962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef54b9-6aa9-48a9-a4ea-edd9e449d74a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:43.922384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c824-431b-4546-b4ee-81d863bfd84d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7FTYpvAoROW28FdwOGCOBg, audit_chain_id=['7FTYpvAoROW28FdwOGCOBg']) at 0x7fe8a15f67c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:43.923218 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c824-431b-4546-b4ee-81d863bfd84d None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:43.923548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c824-431b-4546-b4ee-81d863bfd84d None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:43.923768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c824-431b-4546-b4ee-81d863bfd84d None admin] PATH_INFO: `/v3/domains/4be3c80081d347f3b65fe5ed35251209` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:43.933722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c824-431b-4546-b4ee-81d863bfd84d None admin] RBAC: Authorizing `identity:get_domain(domain_id=4be3c80081d347f3b65fe5ed35251209)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:43.935151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c824-431b-4546-b4ee-81d863bfd84d None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:43.936746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 585/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Fri May 13 12:42:43 2022] GET /identity/v3/domains/4be3c80081d347f3b65fe5ed35251209 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:43.942672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:44.039862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83e2e-60ef-4bda-9cfe-0d13704e092e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:44.071573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5859435-2c86-4d39-9971-c2407b37ad28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7FTYpvAoROW28FdwOGCOBg, audit_chain_id=['7FTYpvAoROW28FdwOGCOBg']) at 0x7fe8a14d3c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:44.072213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859435-2c86-4d39-9971-c2407b37ad28 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:44.072483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859435-2c86-4d39-9971-c2407b37ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:44.072752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5859435-2c86-4d39-9971-c2407b37ad28 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:44.074245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859435-2c86-4d39-9971-c2407b37ad28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:44.075657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5859435-2c86-4d39-9971-c2407b37ad28 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:44.100334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 588/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:42:43 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:42:46.408952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446b4d-885b-4dc2-a726-28477b27cba2 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:46.409501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446b4d-885b-4dc2-a726-28477b27cba2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:46.409501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b446b4d-885b-4dc2-a726-28477b27cba2 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:46.410888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 586/1174] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:46.416277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:46.416718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:46.416938 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:46.434558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:46.435799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:46.499597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 589/1175] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:46.525922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446b4d-885b-4dc2-a726-28477b27cba2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:46.624997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b446b4d-885b-4dc2-a726-28477b27cba2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:46.662526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb89b7b-cc3c-4d28-af96-d3d1b0db8f67 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i1z-rzq3RCGWBPL2Ej8soQ, audit_chain_id=['i1z-rzq3RCGWBPL2Ej8soQ']) at 0x7fe8a2522310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:46.663307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89b7b-cc3c-4d28-af96-d3d1b0db8f67 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:46.663587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89b7b-cc3c-4d28-af96-d3d1b0db8f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:46.663858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb89b7b-cc3c-4d28-af96-d3d1b0db8f67 None admin] PATH_INFO: `/v3/domains/4be3c80081d347f3b65fe5ed35251209` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:46.665039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89b7b-cc3c-4d28-af96-d3d1b0db8f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4be3c80081d347f3b65fe5ed35251209)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:46.666451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb89b7b-cc3c-4d28-af96-d3d1b0db8f67 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:46.668278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 587/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Fri May 13 12:42:46 2022] GET /identity/v3/domains/4be3c80081d347f3b65fe5ed35251209 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:46.674065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:46.766521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f1407b-585c-440a-8dc9-5cc129f9a3c4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:46.798648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518e114-6025-401f-8554-22a56ecfd932 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i1z-rzq3RCGWBPL2Ej8soQ, audit_chain_id=['i1z-rzq3RCGWBPL2Ej8soQ']) at 0x7fe8a14e1580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:46.799196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e114-6025-401f-8554-22a56ecfd932 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:46.799600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e114-6025-401f-8554-22a56ecfd932 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:46.799747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518e114-6025-401f-8554-22a56ecfd932 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:46.800387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e114-6025-401f-8554-22a56ecfd932 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:46.801833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518e114-6025-401f-8554-22a56ecfd932 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:46.823704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 590/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:42:46 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:42:49.096320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf43fa-f9c4-4a51-87d3-86d347a1b2ea None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:49.096864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf43fa-f9c4-4a51-87d3-86d347a1b2ea None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:49.096958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf43fa-f9c4-4a51-87d3-86d347a1b2ea None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:49.098279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 588/1178] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:49.103605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:49.104030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:49.104162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:49.120681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:49.121891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:49.188274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 591/1179] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:49.217482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf43fa-f9c4-4a51-87d3-86d347a1b2ea None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:49.321703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf43fa-f9c4-4a51-87d3-86d347a1b2ea None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:49.354655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tnhRTlubSpeF1gv0INLgeg, audit_chain_id=['tnhRTlubSpeF1gv0INLgeg']) at 0x7fe8a1202c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:49.355427 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:49.355709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:49.355982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:49.365895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:49.373893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:49.375062 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:49.376146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 589/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:49.382680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:49.477568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcaf01-ce54-4c98-aabc-7050c3a6c68d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:49.509529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tnhRTlubSpeF1gv0INLgeg, audit_chain_id=['tnhRTlubSpeF1gv0INLgeg']) at 0x7fe8a14e8d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:49.510178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:49.510481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:49.511447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:49.512247 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:49.512549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:49.513950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:49.522051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 592/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:49.527829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:49.631854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d46c475-7ca0-4beb-ba4c-d73eb60755d1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:49.663978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tnhRTlubSpeF1gv0INLgeg, audit_chain_id=['tnhRTlubSpeF1gv0INLgeg']) at 0x7fe8a1570340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:49.664823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:49.665135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:49.665409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] PATH_INFO: `/v3/users/61255f9c41a04bb2a8c13db12c6362ee` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:49.677767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] RBAC: Authorizing `identity:get_user(user_id=61255f9c41a04bb2a8c13db12c6362ee)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:49.679195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:49.680849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 590/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:49 2022] GET /identity/v3/users/61255f9c41a04bb2a8c13db12c6362ee => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:49.687262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:49.783891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd0247-dc76-49a4-9fae-198aa2c0023b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:49.816908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tnhRTlubSpeF1gv0INLgeg, audit_chain_id=['tnhRTlubSpeF1gv0INLgeg']) at 0x7fe8a155ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:49.817574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:49.817855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:49.818130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:49.887965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:49.889619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:49.991646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 593/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:49.998556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:50.096965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda339e-3e27-48ee-8e21-21a8e2f076f4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:50.129677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7465e-9676-453d-9fc8-14358e7daa3b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tnhRTlubSpeF1gv0INLgeg, audit_chain_id=['tnhRTlubSpeF1gv0INLgeg']) at 0x7fe8a120b430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:50.130508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7465e-9676-453d-9fc8-14358e7daa3b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:50.130784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7465e-9676-453d-9fc8-14358e7daa3b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:50.131050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7465e-9676-453d-9fc8-14358e7daa3b None admin] PATH_INFO: `/v3/projects/214f20fed8234d8e93344e184b882712` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:50.132213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7465e-9676-453d-9fc8-14358e7daa3b None admin] RBAC: Authorizing `identity:get_project(project_id=214f20fed8234d8e93344e184b882712)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:50.133664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7465e-9676-453d-9fc8-14358e7daa3b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:50.135331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 591/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:49 2022] GET /identity/v3/projects/214f20fed8234d8e93344e184b882712 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:50.142232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:50.239687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33827fa-f7bf-4b6f-9f87-3819e9993280 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:50.272599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=tnhRTlubSpeF1gv0INLgeg, audit_chain_id=['tnhRTlubSpeF1gv0INLgeg']) at 0x7fe8a14fba30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:50.273261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:50.273537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:50.273804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:50.274614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=214f20fed8234d8e93344e184b882712, user.id=61255f9c41a04bb2a8c13db12c6362ee) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:50.274917 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:50.276546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4a597c-017a-40c0-bac7-c14aab00a1ef None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:50.281943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 594/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:50 2022] GET /identity/v3/role_assignments?user.id=61255f9c41a04bb2a8c13db12c6362ee&scope.project.id=214f20fed8234d8e93344e184b882712&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:52.465560 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94102c9-d4d8-459a-bad3-063ee0f373bc None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:52.466120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94102c9-d4d8-459a-bad3-063ee0f373bc None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:52.466120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94102c9-d4d8-459a-bad3-063ee0f373bc None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:52.467453 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 592/1186] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:42:52.472552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:52.472949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:52.473127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:52.489551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:52.490719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:52.553202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 595/1187] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:52.576585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94102c9-d4d8-459a-bad3-063ee0f373bc None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:52.676995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94102c9-d4d8-459a-bad3-063ee0f373bc None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:52.709986 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBJaMQXeS-eUPh6yuDNyrg, audit_chain_id=['zBJaMQXeS-eUPh6yuDNyrg']) at 0x7fe8a15288e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:52.710757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:52.711037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:52.711308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:52.721164 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:52.730061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:52.731346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:42:52.732381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 593/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:42:52.737841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:52.838861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127eae5e-71b2-4a00-9783-4005d43971c1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:52.871656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cf631-122d-43d4-b626-89115887f52b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBJaMQXeS-eUPh6yuDNyrg, audit_chain_id=['zBJaMQXeS-eUPh6yuDNyrg']) at 0x7fe8a1505af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:52.872314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cf631-122d-43d4-b626-89115887f52b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:52.872594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cf631-122d-43d4-b626-89115887f52b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:52.872866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666cf631-122d-43d4-b626-89115887f52b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:52.873627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cf631-122d-43d4-b626-89115887f52b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:52.873930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cf631-122d-43d4-b626-89115887f52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:52.875358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666cf631-122d-43d4-b626-89115887f52b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:52.883157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 596/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:52.889609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:52.984047 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466731c6-a67e-4d2f-9eca-10eac2e02247 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:53.020444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBJaMQXeS-eUPh6yuDNyrg, audit_chain_id=['zBJaMQXeS-eUPh6yuDNyrg']) at 0x7fe8a11ed6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:53.021384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:53.021669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:53.021943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] PATH_INFO: `/v3/users/61255f9c41a04bb2a8c13db12c6362ee` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:53.023114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] RBAC: Authorizing `identity:get_user(user_id=61255f9c41a04bb2a8c13db12c6362ee)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:53.024557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:53.026271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 594/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:52 2022] GET /identity/v3/users/61255f9c41a04bb2a8c13db12c6362ee => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:53.031970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cf631-122d-43d4-b626-89115887f52b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:53.129601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666cf631-122d-43d4-b626-89115887f52b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:53.164311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e0c4fb-8a4c-4f12-b505-b23e3e9ceb33 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBJaMQXeS-eUPh6yuDNyrg, audit_chain_id=['zBJaMQXeS-eUPh6yuDNyrg']) at 0x7fe8a1579880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:53.165183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0c4fb-8a4c-4f12-b505-b23e3e9ceb33 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:53.165463 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0c4fb-8a4c-4f12-b505-b23e3e9ceb33 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:53.165730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e0c4fb-8a4c-4f12-b505-b23e3e9ceb33 None admin] PATH_INFO: `/v3/projects/214f20fed8234d8e93344e184b882712` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:53.167870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0c4fb-8a4c-4f12-b505-b23e3e9ceb33 None admin] RBAC: Authorizing `identity:get_project(project_id=214f20fed8234d8e93344e184b882712)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:53.169454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e0c4fb-8a4c-4f12-b505-b23e3e9ceb33 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:53.171473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 597/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:53 2022] GET /identity/v3/projects/214f20fed8234d8e93344e184b882712 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:53.177620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:53.274289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660c1e2-dad6-4223-8009-ef3433eafca8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:53.305817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b82ee-ba34-42c3-b747-3e9d918ed04b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zBJaMQXeS-eUPh6yuDNyrg, audit_chain_id=['zBJaMQXeS-eUPh6yuDNyrg']) at 0x7fe8a11909a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:53.306699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b82ee-ba34-42c3-b747-3e9d918ed04b None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:53.306979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b82ee-ba34-42c3-b747-3e9d918ed04b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:53.307253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b82ee-ba34-42c3-b747-3e9d918ed04b None admin] PATH_INFO: `/v3/projects/214f20fed8234d8e93344e184b882712/users/61255f9c41a04bb2a8c13db12c6362ee/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:53.309835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b82ee-ba34-42c3-b747-3e9d918ed04b None admin] RBAC: Authorizing `identity:create_grant(project_id=214f20fed8234d8e93344e184b882712, user_id=61255f9c41a04bb2a8c13db12c6362ee, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:53.311258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b82ee-ba34-42c3-b747-3e9d918ed04b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:53.325464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 595/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:42:53 2022] PUT /identity/v3/projects/214f20fed8234d8e93344e184b882712/users/61255f9c41a04bb2a8c13db12c6362ee/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:42:55.553529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd6a3-4b8e-4e14-ba05-cfd2e282eba6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:55.554065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd6a3-4b8e-4e14-ba05-cfd2e282eba6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:55.554065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd6a3-4b8e-4e14-ba05-cfd2e282eba6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:55.555422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 598/1193] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:42:55.561125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:55.561559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:55.561662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:55.578557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:42:55.579721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:42:55.643546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 596/1194] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:42:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:42:55.666303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd6a3-4b8e-4e14-ba05-cfd2e282eba6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:55.769229 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd6a3-4b8e-4e14-ba05-cfd2e282eba6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:55.807003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KrabwGvSSM-PPI0JvJhY-g, audit_chain_id=['KrabwGvSSM-PPI0JvJhY-g']) at 0x7fe8a182edc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:55.807755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:55.808029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:55.808955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:55.819702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:42:55.827297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:42:55.828519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:42:55.829597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 599/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:42:55.834859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:55.928389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c3def-04c3-4c30-bc57-6591943db29c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:55.962838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KrabwGvSSM-PPI0JvJhY-g, audit_chain_id=['KrabwGvSSM-PPI0JvJhY-g']) at 0x7fe8a15f6e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:55.963495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:55.964225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:55.964590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:55.965415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:55.965722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:55.967149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:55.977439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 597/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:55.983625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:56.082406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c435b1-f374-4e2e-b8aa-bbae5d5797c6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:56.116236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KrabwGvSSM-PPI0JvJhY-g, audit_chain_id=['KrabwGvSSM-PPI0JvJhY-g']) at 0x7fe8a14a31c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:56.117131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:56.117400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:56.117667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] PATH_INFO: `/v3/users/61255f9c41a04bb2a8c13db12c6362ee` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:56.118854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] RBAC: Authorizing `identity:get_user(user_id=61255f9c41a04bb2a8c13db12c6362ee)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:56.120802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:56.122464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 600/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Fri May 13 12:42:55 2022] GET /identity/v3/users/61255f9c41a04bb2a8c13db12c6362ee => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:56.129956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:56.227871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d631d8-ef0e-4a77-a936-711fc0c55124 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:56.262944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KrabwGvSSM-PPI0JvJhY-g, audit_chain_id=['KrabwGvSSM-PPI0JvJhY-g']) at 0x7fe8a155ae80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:56.263579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:56.263854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:56.264120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:56.350940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:56.352291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:56.445915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 598/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:42:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:42:56.452623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:56.554145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bef546-9fb1-402e-bb9d-e6775e47950e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:56.590640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d63159-7b18-4bee-90f2-6d2e889db2c3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KrabwGvSSM-PPI0JvJhY-g, audit_chain_id=['KrabwGvSSM-PPI0JvJhY-g']) at 0x7fe8a15541f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:56.591477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63159-7b18-4bee-90f2-6d2e889db2c3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:56.591757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63159-7b18-4bee-90f2-6d2e889db2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:56.592030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d63159-7b18-4bee-90f2-6d2e889db2c3 None admin] PATH_INFO: `/v3/projects/214f20fed8234d8e93344e184b882712` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:56.593220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d63159-7b18-4bee-90f2-6d2e889db2c3 None admin] RBAC: Authorizing `identity:get_project(project_id=214f20fed8234d8e93344e184b882712)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:56.594642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d63159-7b18-4bee-90f2-6d2e889db2c3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:56.596331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 601/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Fri May 13 12:42:56 2022] GET /identity/v3/projects/214f20fed8234d8e93344e184b882712 => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:42:56.602470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:42:56.708060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df9418-9255-42c2-b7ff-6a5f6a4f3632 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:42:56.741472 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KrabwGvSSM-PPI0JvJhY-g, audit_chain_id=['KrabwGvSSM-PPI0JvJhY-g']) at 0x7fe8a1581670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:42:56.742121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:42:56.742403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:42:56.742678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:42:56.743502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=214f20fed8234d8e93344e184b882712, user.id=61255f9c41a04bb2a8c13db12c6362ee) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:42:56.743813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:42:56.745749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6df50af-eae9-4791-ba87-041b4c0bf4fc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:42:56.751416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 599/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:42:56 2022] GET /identity/v3/role_assignments?user.id=61255f9c41a04bb2a8c13db12c6362ee&scope.project.id=214f20fed8234d8e93344e184b882712&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:43:58.833912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77f51-5b3d-44de-9567-b73d5e434bd0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:43:58.834635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77f51-5b3d-44de-9567-b73d5e434bd0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:43:58.834635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c77f51-5b3d-44de-9567-b73d5e434bd0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:43:58.836043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 602/1201] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:43:58.843077 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:43:58.843667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:43:58.843667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:43:58.872488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:43:58.874029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:43:58.952641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 600/1202] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:43:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:43:58.978848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c77f51-5b3d-44de-9567-b73d5e434bd0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:43:59.107382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c77f51-5b3d-44de-9567-b73d5e434bd0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:43:59.147582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MoOXlN1rTgGEheP1TRxEZQ, audit_chain_id=['MoOXlN1rTgGEheP1TRxEZQ']) at 0x7fe8a1523100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:43:59.148782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:43:59.149082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:43:59.149335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:43:59.161263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:43:59.163106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:43:59.181753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:43:59.183365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:43:59.184539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:43:59.184539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:43:59.184539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:43:59.184539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:43:59.184539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 603/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:43:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:43:59.190354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:43:59.304753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4232d7b-4a9b-4cd8-8f0a-480161f03d0a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:43:59.344868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MoOXlN1rTgGEheP1TRxEZQ, audit_chain_id=['MoOXlN1rTgGEheP1TRxEZQ']) at 0x7fe8a1524910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:43:59.345809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:43:59.346290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:43:59.346712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:43:59.347591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:43:59.348083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:43:59.349456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a71bc-ba35-4615-8bb1-72b0245c636c None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:43:59.365140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 601/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:43:59.369927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:43:59.477390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63097fb4-3358-4312-bc30-36ae0ab816f4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:43:59.515512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea2fdcf-492a-40e9-bf13-ed1e7bacde22 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=MoOXlN1rTgGEheP1TRxEZQ, audit_chain_id=['MoOXlN1rTgGEheP1TRxEZQ']) at 0x7fe8a155e220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:43:59.516226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2fdcf-492a-40e9-bf13-ed1e7bacde22 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:43:59.516511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2fdcf-492a-40e9-bf13-ed1e7bacde22 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:43:59.517069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea2fdcf-492a-40e9-bf13-ed1e7bacde22 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:43:59.520431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2fdcf-492a-40e9-bf13-ed1e7bacde22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:43:59.522200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea2fdcf-492a-40e9-bf13-ed1e7bacde22 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:43:59.547645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 604/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Fri May 13 12:43:59 2022] POST /identity/v3/users => generated 251 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:44:02.125535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc1d68-0947-4056-90a8-4de90e4fcc3e None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:02.126078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc1d68-0947-4056-90a8-4de90e4fcc3e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:02.126078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc1d68-0947-4056-90a8-4de90e4fcc3e None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:02.127607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 602/1206] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:02.133062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:02.133501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:02.135459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:02.153019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:02.154197 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:02.225954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 605/1207] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:02.250547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc1d68-0947-4056-90a8-4de90e4fcc3e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:02.366707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc1d68-0947-4056-90a8-4de90e4fcc3e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:02.408025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a14e9220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:02.408831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:02.409140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:02.409409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:02.421980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:44:02.431122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:02.434368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:02.435963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 603/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:44:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:02.440788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:02.571674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30150-596e-4e4d-b698-f97d48ff507e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:02.618248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a1790850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:02.619176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:02.619477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:02.619754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:02.621426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:02.621767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:02.623174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:02.640932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 606/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:02.642323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:02.754381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2977e-e4d4-4dea-b3ca-20d25695c842 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:02.795953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a160cc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:02.796918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:02.797249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:02.797528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:02.809866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:02.811425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:02.836668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:02.837619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:02.838532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:02.838532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:02.838532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:02.838532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:02.838532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 604/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:44:02.841304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:02.955322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32a956-62f5-4ede-8cdb-f442c2bb47be None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:03.001545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a1568430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:03.002332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:03.002681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:03.002952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:03.003822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:03.004133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:03.005763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:03.019547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 607/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:03.025230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:03.154721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c73777-e2d4-4bdd-a27d-adea1bdd15eb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:03.193246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a1557bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:03.194152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:03.194529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:03.194876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:03.204080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:03.205575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:44:03.222923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:03.224366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:03.225733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:03.233421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 605/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:03.234712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:03.349134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f2b51-8f5d-4a31-a1ed-d1347a6d3683 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:03.393457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a14e2be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:03.397326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:03.397623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:03.397900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:03.398830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:03.399141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:03.400593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:03.422390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 608/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Fri May 13 12:44:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:03.430294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:03.555789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f591eda-c684-4868-83a5-8a8a122b10b0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:03.604278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a14fb3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:03.605824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:03.606153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:03.606448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:03.695786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:03.698159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:03.837753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 606/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:44:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:44:03.845383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:03.971389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885efa15-3342-412d-96e0-0d78a93bfa32 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:04.009745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a14e2040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:04.010785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:04.011074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:04.011428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:04.027682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:04.030137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:04.049818 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:04.052715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:04.053880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:04.053880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:04.053880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:04.053880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:04.053880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 609/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:04.058173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:04.195518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a848cf8d-babb-4de3-ad80-e75004db52c7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:04.238280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a15576a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:04.239054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:04.239481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:04.239908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:04.240796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:04.241297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:04.243045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:04.266366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 607/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:04.267985 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:04.440344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13443c-9f74-4f50-a558-b7adc125080f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:04.483367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a14e8d30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:04.484175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:04.484448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:04.487308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:04.498707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:04.500430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:44:04.517807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:04.519491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:04.520685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:04.522077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 610/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:44:04.530180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:04.661961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76636a13-05fd-479c-8dce-f9307d19cdad None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:04.705840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a15f6e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:04.706650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:04.706966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:04.708447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:04.708447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:04.708654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:04.710381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4b9fdc-29f9-4695-97ae-98b9385c8abc None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:04.732733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 608/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:04.734457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:04.880894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcc38f-5994-418b-b9fa-a0623e58bfd8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:04.918209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=k1SAvulRRP6M8RiB8EBEoQ, audit_chain_id=['k1SAvulRRP6M8RiB8EBEoQ']) at 0x7fe8a151daf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:04.918951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:04.919252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:04.919524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:04.920472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=00056de203d84284a032f715ef2d6a3d) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:04.920733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:04.922356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9add2a-799a-48b2-af9c-54d1dc9f3495 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:04.930994 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 611/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:44:04 2022] GET /identity/v3/role_assignments?user.id=00056de203d84284a032f715ef2d6a3d&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:07.304795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7a13-4ba3-4507-934b-968b6cdc570e None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:07.305351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7a13-4ba3-4507-934b-968b6cdc570e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:07.305351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa7a13-4ba3-4507-934b-968b6cdc570e None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:07.306772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 609/1220] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:44:07.313032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:07.313500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:07.313585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:07.331702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:07.332914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:07.407669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 612/1221] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:07.431991 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa7a13-4ba3-4507-934b-968b6cdc570e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:07.587852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa7a13-4ba3-4507-934b-968b6cdc570e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:07.625554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a1176940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:07.626339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:07.626618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:07.626891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:07.637511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:44:07.645421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:07.646343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:07.647209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 610/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:07.653390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:07.750989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85553e2-5ac8-46ee-bab6-2a42021c9e94 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:07.788940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a139aac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:07.789640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:07.789922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:07.790195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:07.790942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:07.791268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:07.792882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:07.801805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 613/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:07.808071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:07.919426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b572b-98be-46c6-9ac8-f54bafffecc3 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:07.955038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a14e9f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:07.955904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:07.956111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:07.956412 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:07.970113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:07.970113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:07.991282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:07.992290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:07.993636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:07.993636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:07.993636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:07.993636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:07.993636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 611/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 13 12:44:07.998417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:08.114651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6cd74-8169-4d91-a53a-dfd362ec6f6e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:08.157867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a1549160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:08.158498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:08.158805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:08.159108 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:08.159919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:08.160241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:08.161752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:08.180394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 614/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:08.181966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:08.320318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac15e-0375-4fda-a5ed-00579c32e208 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:08.362441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a14cb7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:08.363345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:08.363633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:08.363917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:08.372686 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:08.374346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:44:08.394188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:08.395516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:08.396922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 612/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:08.402639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:08.525116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a942bc-1af8-4f9f-afa2-b81a5e2bae28 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:08.565283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a15074f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:08.565957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:08.566244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:08.566507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:08.567343 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:08.567667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:08.569092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:08.604426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 615/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Fri May 13 12:44:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:08.608975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:08.714056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea53a28-43ab-45d0-89a0-9227ab856399 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:08.757220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a14cba00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:08.758820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:08.759482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:08.760043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:08.776756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:08.778294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:08.797572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:08.798868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:08.800152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:08.800152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:08.800152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:08.800152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:08.800152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 613/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:08.804774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:08.928848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba445111-cb2f-4a63-beb3-ef1adcc3f229 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:08.967953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a142ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:08.969088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:08.969570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:08.971715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:08.971715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:08.972035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:08.974136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:08.992296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 616/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:08.998389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:09.106534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac7c12-9c8f-44d9-b416-7b136a24ffb7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:09.139511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a1812e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:09.140298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:09.140575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:09.140847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:09.148339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:09.149951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:44:09.165076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:09.166172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:09.167454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 614/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:09.172460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:09.283691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78915a-12f7-43b5-beea-f03d9cb46df6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:09.320180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a14fa0d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:09.320838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:09.321295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:09.321559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:09.322388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:09.322685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:09.324418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542b769-7546-47ab-90bd-0430c8963043 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:09.336708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 617/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:09.343355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:09.456507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13db8c-2966-46de-bd63-aabe1f471a61 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:09.493180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5e6e9-0d33-4e61-bef1-05d512995389 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sbV_hcFmQa2D7FpMzWrMlA, audit_chain_id=['sbV_hcFmQa2D7FpMzWrMlA']) at 0x7fe8a14fb460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:09.494072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e6e9-0d33-4e61-bef1-05d512995389 None admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:09.494358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e6e9-0d33-4e61-bef1-05d512995389 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:09.494635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5e6e9-0d33-4e61-bef1-05d512995389 None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/00056de203d84284a032f715ef2d6a3d/roles/0b13f2dc4d184152b0eef0b66686bafa` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:09.511916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e6e9-0d33-4e61-bef1-05d512995389 None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=00056de203d84284a032f715ef2d6a3d, role_id=0b13f2dc4d184152b0eef0b66686bafa)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:09.513406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5e6e9-0d33-4e61-bef1-05d512995389 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:09.526094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 615/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:44:09 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/00056de203d84284a032f715ef2d6a3d/roles/0b13f2dc4d184152b0eef0b66686bafa => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:44:11.973825 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461356-1bd0-4f34-b896-89f9bf70e74d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:11.974286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461356-1bd0-4f34-b896-89f9bf70e74d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:11.974399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f461356-1bd0-4f34-b896-89f9bf70e74d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:11.976192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 618/1233] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:11.982125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:11.982594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:11.982684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:12.002415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:12.003895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:12.096958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 616/1234] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:12.123370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461356-1bd0-4f34-b896-89f9bf70e74d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:12.261617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f461356-1bd0-4f34-b896-89f9bf70e74d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:12.303758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a182e430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:12.304546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:12.304821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:12.305192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:12.319299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:44:12.328113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:12.329176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:12.330035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 619/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Fri May 13 12:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:12.336568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:12.457352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f8b73-ff10-4891-9038-8871eed4dd86 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:12.505619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a1190fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:12.506255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:12.506536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:12.506808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:12.507593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] RBAC: Adding query filter params (name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:12.507908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:12.509363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:12.519744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 617/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Fri May 13 12:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:12.525873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:12.639759 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680afa74-95e1-4f09-b4bc-ec4e4a1fcf9b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:12.682031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a1523d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:12.683425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:12.683701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:12.684119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:12.695296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:12.696797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:12.714564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:12.715756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:12.717003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:12.717003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:12.717003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:12.717003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:12.717003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 620/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:12.722009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:12.825551 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc19172-efc9-4ec1-8f26-e28133d2468b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:12.860058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a1524970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:12.860726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:12.861030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:12.861306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:12.862017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:12.862343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:12.863820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:12.880446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 618/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:12.886264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:13.011132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9a780-ac8b-43ee-99f9-f441d2b9d1b2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:13.050096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a153beb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:13.051384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:13.051961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:13.052269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:13.060736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:13.062474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:44:13.086321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:13.087557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:13.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:13.094930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 621/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:13.096640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:13.218039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0871ea-1d61-42f1-8f8a-f140bea0c5f3 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:13.264592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a14cb490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:13.265368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:13.265725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:13.265996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:13.266832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:13.267393 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:13.268914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:13.289202 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 619/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Fri May 13 12:44:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:44:13.294997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:13.420022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981fcfb-0eb2-41b8-a05f-4d325e07dc91 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:13.457113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a14a3400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:13.457775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:13.458060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:13.458317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:13.530739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:13.532205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:13.642985 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 622/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:44:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:44:13.649708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:13.765702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0468e9d-7404-485e-bc80-ce02192bd918 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:13.804697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a1190160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:13.805515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:13.805809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:13.806076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:13.816540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:13.818195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:13.836822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:13.838446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:13.839932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:13.839932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:13.839932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:13.839932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:13.839932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 620/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:13.844486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:13.952935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851232f3-29de-4c08-a030-2081dec14602 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:13.990462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a17e6640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:13.991127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:13.991424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:13.991690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:13.992478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:13.992696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:13.994142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:14.006300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 623/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:44:14.012963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:14.131891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973183b3-1a7d-49ec-b477-432edc700c53 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:14.176498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a11dabb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:14.177328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:14.177608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:14.177884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:14.185412 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:14.186881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:44:14.201738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:14.202722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:14.203615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 621/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:14.209593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:14.321199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49d7d8-50d5-4726-885e-ff9a407c64f8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:14.358195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a1512dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:14.358940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:14.359295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:14.359668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:14.360538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:14.361040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:14.362609 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852580e9-dc15-4817-9a1f-0546d814b374 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:14.375634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 624/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:14.381750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:14.491305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12cf799-9a0b-4411-b152-71a6524248d7 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:14.529435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=cicpbvw9S7qLWcw3q2NT3g, audit_chain_id=['cicpbvw9S7qLWcw3q2NT3g']) at 0x7fe8a118eb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:14.530181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:14.530455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:14.530805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:14.531689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] RBAC: Adding query filter params (role.id=0b13f2dc4d184152b0eef0b66686bafa, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=00056de203d84284a032f715ef2d6a3d) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:14.532049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:14.533536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24b672-4e2c-47b4-ac75-a2bd5883054a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:14.540355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 622/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:44:14 2022] GET /identity/v3/role_assignments?user.id=00056de203d84284a032f715ef2d6a3d&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=0b13f2dc4d184152b0eef0b66686bafa => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:16.872920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc53b-2bb0-417b-ace3-4d4297c4aeae None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:16.873507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc53b-2bb0-417b-ace3-4d4297c4aeae None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:16.873507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3afc53b-2bb0-417b-ace3-4d4297c4aeae None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:16.874900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 625/1247] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:16.881056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:16.881549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:16.881549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:16.900195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:16.902119 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:16.977859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 623/1248] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:17.004858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc53b-2bb0-417b-ace3-4d4297c4aeae None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:17.120485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3afc53b-2bb0-417b-ace3-4d4297c4aeae None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:17.159879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a180ca30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:17.160839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:17.161175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:17.161475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:17.173380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:44:17.181572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:17.182841 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:44:17.183858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:17.188014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 626/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:17.189077 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:17.305325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c3523-6648-40a7-af27-5066ca9647a8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:17.345453 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a14fb040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:17.346400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:17.346640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:17.346854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:17.347703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:17.348014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:17.349533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:17.359334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 624/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:17.365447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:17.473517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1708a4f-5802-41ca-8035-3936ccb04cf8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:17.511460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a14a3a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:17.512394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:17.512747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:17.513049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:17.526523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:17.528664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:17.546615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:17.547879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:17.549233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:17.549233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:17.549233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:17.549233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:17.549233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 627/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:17.554316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:17.662985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397b842-8bd9-4357-8fe5-1d259baf3eb8 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:17.700280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a14e9430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:17.701010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:17.701362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:17.701644 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:17.702339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:17.702642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:17.704069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:17.716783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 625/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:17.722892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:17.838226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aba80-51ac-4c16-8b45-ba3dc190ad3c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:17.874384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a1515910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:17.875183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:17.875461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:17.875734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:17.883534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:17.885072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:44:17.901822 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:17.903663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:17.904824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 628/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:17.910086 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:18.019136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8080f2b-0cdc-443d-abec-d33d61b39fcb None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:18.054450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a2522700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:18.056326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:18.056326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:18.056326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:18.056609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:18.056769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:18.058241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:18.075993 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 626/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Fri May 13 12:44:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:18.081808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:18.186642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e083cc0-9f1a-4d65-931e-cbbeb8087e70 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:18.224092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a157c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:18.225132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:18.225527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:18.225785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:18.309251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:18.310717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:18.416334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 629/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:44:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:44:18.422539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:18.534973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63b8da3-dbb2-4b96-bf00-eb40b74f00e0 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:18.568702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a11daac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:18.569524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:18.569832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:18.570144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:18.585188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:18.586683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:18.606432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:18.608897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:18.610040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:18.610040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:18.610040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:18.610040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:18.610040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 627/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:18.613394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:18.720256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ebc88-cead-490d-bf03-3a4bf12f310b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:18.756608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a14ee7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:18.757307 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:18.757583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:18.757851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:18.758578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:18.758883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:18.760282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:18.773876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 630/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:44:18.779924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:18.883571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897ade3-0cb7-4748-8b12-bd92f47bf12e None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:18.918969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a118e4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:18.919896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:18.920241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:18.920584 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:18.928221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:18.929709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:44:18.944680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:18.945846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:18.947059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 628/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:44:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:18.952705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:19.058138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f81d1b-0fdb-4004-a04a-143b37c24e83 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:19.091672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a142ea60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:19.092326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:19.092606 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:19.092871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:19.093671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:19.093977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:19.095394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5219bcd-c6d4-440c-9b76-fe87d6107b6a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:19.107830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 631/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:44:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:19.113979 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:19.215736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9c328-f2e3-4ff6-8789-e4baf697ab93 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:19.253650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=eF8GlPxURLOqVdzeOdB8mg, audit_chain_id=['eF8GlPxURLOqVdzeOdB8mg']) at 0x7fe8a11e9be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:19.254314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:19.254676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:19.254840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:19.255711 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=00056de203d84284a032f715ef2d6a3d) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:19.256005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:19.257461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a776a96b-8884-40fa-97c9-c1de1da8b904 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:19.264284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 629/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:44:19 2022] GET /identity/v3/role_assignments?user.id=00056de203d84284a032f715ef2d6a3d&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:21.544137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c17e0-b5b2-4a41-a577-cef16da0f236 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:21.544681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c17e0-b5b2-4a41-a577-cef16da0f236 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:21.544681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c17e0-b5b2-4a41-a577-cef16da0f236 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:21.546074 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 632/1261] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:21.551315 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:21.551712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:21.551866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:21.569019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:21.570194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:21.636141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 630/1262] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:21.658417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c17e0-b5b2-4a41-a577-cef16da0f236 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:21.769199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c17e0-b5b2-4a41-a577-cef16da0f236 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:21.801620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a15494c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:21.802320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:21.802593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:21.802861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:21.813185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:44:21.820487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:21.821657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:21.822871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 633/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:44:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:21.827911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:21.927492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a3bb3-aecb-4bf1-8c08-a8b3b0030774 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:21.961693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a1582820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:21.962350 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:21.962712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:21.962978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:21.963713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:21.964047 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:21.965457 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:21.973954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 631/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:44:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:21.980370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:22.086861 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc0284a-7351-48d8-bcaf-7d2e6a47c9c7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:22.119140 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a13b74f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:22.119908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:22.121022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:22.121022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:22.130840 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:22.132199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:22.149569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:22.150589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:22.152465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:22.152465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:22.152465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:22.152465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:22.152465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 634/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:22.157115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:22.271054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098b7c9-98e3-4f64-a47b-1d6b751dc99b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:22.304690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a14e99d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:22.305365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:22.305645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:22.305916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:22.306627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:22.306929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:22.308954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:22.320082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 632/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:22.325740 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:22.433014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3bb0d-01bb-444d-8185-a8ac4330c59c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:22.466871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a132da90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:22.467655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:22.467934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:22.468201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:22.475512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:22.476944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:44:22.490562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:22.491686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:22.492855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 635/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:22.497803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:22.593514 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b332b4-5c01-4afb-a23c-5d81b3fc032a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:22.625541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a160c7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:22.626198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:22.626479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:22.626752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:22.627572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:22.627880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:22.629322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:22.646472 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 633/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Fri May 13 12:44:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:22.652791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:22.748023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ff36c-9ee6-4220-908f-448034b169c4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:22.780228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a15251c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:22.781017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:22.781301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:22.781570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:22.791653 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:22.793344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:22.810009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:22.811044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:22.812002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:22.812002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:22.812002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:22.812002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:22.812002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 636/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:22.816940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:22.911214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401441dd-1191-43b6-912e-df723d1b6f8b None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:22.944782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a1812490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:22.945466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:22.945744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:22.946015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:22.946731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:22.947032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:22.948995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:22.959901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 634/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:22.968613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:23.068009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab44283-2fa1-4291-bc33-8cf15f37bf02 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:23.099713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a13bf730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:23.100484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:23.100781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:23.101075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:23.107945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:23.109396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:44:23.123437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:23.124492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:23.125471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 637/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:44:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:23.130393 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:23.236704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985b232-0988-40e1-b3b5-28af4e2c0f07 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:23.273749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a1581d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:23.274401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:23.274687 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:23.275023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:23.275913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:23.276227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:23.277861 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f111f9d4-e577-471d-805e-5874548a6ed9 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:23.289564 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 635/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:23.296164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:23.407915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceec9f8-26e6-4216-821a-6d1ef367aba6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:23.444589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8a0d3-cc9c-4e47-a7bd-370272ab547f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zSDbikPPRQ-wooQR_6B10w, audit_chain_id=['zSDbikPPRQ-wooQR_6B10w']) at 0x7fe8a15540a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:23.445518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8a0d3-cc9c-4e47-a7bd-370272ab547f None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:23.445797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8a0d3-cc9c-4e47-a7bd-370272ab547f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:23.446071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8a0d3-cc9c-4e47-a7bd-370272ab547f None admin] PATH_INFO: `/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/00056de203d84284a032f715ef2d6a3d/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:23.448058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8a0d3-cc9c-4e47-a7bd-370272ab547f None admin] RBAC: Authorizing `identity:create_grant(project_id=0612cc0f32c14b0ab7f07ed29011e61c, user_id=00056de203d84284a032f715ef2d6a3d, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:23.449664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8a0d3-cc9c-4e47-a7bd-370272ab547f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:23.462188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 638/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Fri May 13 12:44:23 2022] PUT /identity/v3/projects/0612cc0f32c14b0ab7f07ed29011e61c/users/00056de203d84284a032f715ef2d6a3d/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:44:25.677146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2b746-9970-480b-958c-17e45447cafa None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:25.677842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2b746-9970-480b-958c-17e45447cafa None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:25.677842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2b746-9970-480b-958c-17e45447cafa None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:25.679032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 636/1274] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:25.684326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:25.684781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:25.684883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:25.701675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:25.702844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:25.766626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 639/1275] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:44:25.789596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2b746-9970-480b-958c-17e45447cafa None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:25.891264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2b746-9970-480b-958c-17e45447cafa None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:25.926396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a14b4040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:25.927229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:25.927459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:25.927730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:25.938519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(role_id) May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 13 12:44:25.945891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:25.946982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:25.947873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 637/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Fri May 13 12:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:25.953758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:26.047065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406af2c9-1496-4b0f-b270-894907aca0e1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:26.082539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a14e1cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:26.083189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:26.083467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:26.083739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:26.084481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:26.084784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:26.086168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:26.094051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 640/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Fri May 13 12:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:26.099689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:26.197132 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e480f-2903-4326-af61-9af9a6e0b6c1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:26.235199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a120b250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:26.236166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:26.236515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:26.237174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:26.251018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:26.252723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:26.274039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:26.275175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:26.276292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:26.276292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:26.276292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:26.276292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:26.276292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 638/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:26.282450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:26.379719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc55c46-0e9f-4ef7-a77c-cb46beeaab8e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:26.410877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a157c190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:26.411525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:26.411804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:26.412073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:26.412794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:26.413116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:26.414476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:26.426308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 641/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:26.431965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:26.527253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69edca1c-1a3f-434f-ae89-f4bd5e624fe1 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:26.564908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a14cba00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:26.565957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:26.566426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:26.566761 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:26.575785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:26.577716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_user(user_id) May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 13 12:44:26.594010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:26.595278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:26.596398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 639/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:26.600860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:26.701048 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8538a1c-df44-4c91-9fa5-834b8748e669 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:26.736874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a1523c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:26.737602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:26.737932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:26.738213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:26.739111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:26.739441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:26.740931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:26.757907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 642/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Fri May 13 12:44:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:26.763700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:26.860007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba200d4a-ebbe-45b2-b983-e734db1ead72 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:26.892797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a14f1340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:26.893468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:26.893750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:26.894026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:26.957663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:26.959093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:27.054817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 640/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Fri May 13 12:44:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 13 12:44:27.060754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:27.155804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf7e59-f106-4e83-9d3d-3abf984a475e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:27.186877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a155e760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:27.187640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:27.187910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:27.188176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:27.197649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:27.200031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 13 12:44:27.222182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:27.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:27.230443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 13 12:44:27.230443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 13 12:44:27.230443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 13 12:44:27.230443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:27.230443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 643/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:27.230860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:27.324855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4410385-507d-4b06-bddd-cd25206976f4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:27.356945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a1464ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:27.357616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:27.357892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:27.358161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:27.358868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:27.359162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:27.360501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:27.371867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 641/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Fri May 13 12:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:44:27.378083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:27.474340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76e6e6-db4e-42e5-ae91-87cf1da49f7f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:27.506618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a17fd460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:27.507384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:27.507658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:27.507925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:27.514698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:27.516110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(project_id) May 13 12:44:27.530303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application with Lock( May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:27.532038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: ERROR keystone.server.flask.application May 13 12:44:27.533873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 644/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Fri May 13 12:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:27.537204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:27.632575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ace75-749f-4e74-8b80-3b48c998aace None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:27.666369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a160cc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:27.667034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:27.667331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:27.667603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:27.668376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:27.668681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:27.670124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a1390-6728-474a-bdf7-9ea2363876fe None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:27.681713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 642/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Fri May 13 12:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:27.687879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:27.785526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07113234-6c69-4f36-9c5e-df23286a97a6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:27.816621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=c3s4haCuQW6GmcTlwkl8TA, audit_chain_id=['c3s4haCuQW6GmcTlwkl8TA']) at 0x7fe8a131ff10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:27.817368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:27.817642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:27.817910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:27.818723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] RBAC: Adding query filter params (role.id=b40b60e4a9ee43fda91654b1667cba2a, scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c, user.id=00056de203d84284a032f715ef2d6a3d) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:27.819023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:27.820432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4798d7-6fa9-440e-8f4b-3de820017fd6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:27.826784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 645/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Fri May 13 12:44:27 2022] GET /identity/v3/role_assignments?user.id=00056de203d84284a032f715ef2d6a3d&scope.project.id=0612cc0f32c14b0ab7f07ed29011e61c&role.id=b40b60e4a9ee43fda91654b1667cba2a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:30.053865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee642639-a718-4df1-b545-43684fd790ed None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:30.054437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee642639-a718-4df1-b545-43684fd790ed None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:30.054437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee642639-a718-4df1-b545-43684fd790ed None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:30.055762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 643/1288] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:30.061255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:30.061706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:30.061805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:30.079050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:30.080232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:30.144277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 646/1289] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 13 12:44:30.166735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee642639-a718-4df1-b545-43684fd790ed None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:30.280662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee642639-a718-4df1-b545-43684fd790ed None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:30.317713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i-ZNHk7VThaVxn6-GyHkYA, audit_chain_id=['i-ZNHk7VThaVxn6-GyHkYA']) at 0x7fe8a11ed880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:30.318502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:30.318778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:30.319045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:30.319688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:30.321061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:30.333335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:30.334445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:30.335618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 644/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:44:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:30.341508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:30.436736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9734993c-1117-44e5-808e-6eef38e50c79 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:30.470490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i-ZNHk7VThaVxn6-GyHkYA, audit_chain_id=['i-ZNHk7VThaVxn6-GyHkYA']) at 0x7fe8a1549340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:30.471138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:30.471414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:30.471683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:30.472376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:30.472676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:30.474064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed2c23-3be9-444c-90a5-cc285ddf1a6c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:30.478633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 647/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Fri May 13 12:44:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:30.484524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:30.581665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10350d6-24ee-4029-935d-d8772efa41b4 None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:30.614701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=i-ZNHk7VThaVxn6-GyHkYA, audit_chain_id=['i-ZNHk7VThaVxn6-GyHkYA']) at 0x7fe8a1122a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:30.615352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:30.615629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:30.615896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] PATH_INFO: `/v3/services` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:30.616588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] RBAC: Adding query filter params (type=placement) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:30.616890 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:30.618278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0717ebc-1129-4e94-82b3-d285705573fb None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:30.623340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 645/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Fri May 13 12:44:30 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:32.843178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754110f-e9f9-4c73-973a-f3e7446fc294 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:32.843723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754110f-e9f9-4c73-973a-f3e7446fc294 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:32.843723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754110f-e9f9-4c73-973a-f3e7446fc294 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:32.845137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 648/1293] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:32.851202 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ced71-86a8-4bd3-9d42-55a089f395b6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:32.851648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ced71-86a8-4bd3-9d42-55a089f395b6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:32.851779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ced71-86a8-4bd3-9d42-55a089f395b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:32.868864 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9c3ced71-86a8-4bd3-9d42-55a089f395b6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:32.870096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9c3ced71-86a8-4bd3-9d42-55a089f395b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:32.935690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 646/1294] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:32.958173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754110f-e9f9-4c73-973a-f3e7446fc294 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:33.055764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b754110f-e9f9-4c73-973a-f3e7446fc294 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:33.088072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af632b7-9fcb-4f45-9b3b-2c91873d25f7 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=W4dx78N9Sx2gDKKBWC32yA, audit_chain_id=['W4dx78N9Sx2gDKKBWC32yA']) at 0x7fe8a138f820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:33.088726 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af632b7-9fcb-4f45-9b3b-2c91873d25f7 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:33.089645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af632b7-9fcb-4f45-9b3b-2c91873d25f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:33.089920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af632b7-9fcb-4f45-9b3b-2c91873d25f7 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:33.090648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af632b7-9fcb-4f45-9b3b-2c91873d25f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:33.092195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af632b7-9fcb-4f45-9b3b-2c91873d25f7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:33.105262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 649/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Fri May 13 12:44:32 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:44:35.366258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22926254-1444-4553-a440-3cc9097900b0 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:35.366809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22926254-1444-4553-a440-3cc9097900b0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:35.366809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22926254-1444-4553-a440-3cc9097900b0 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:35.368050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 647/1296] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:35.374189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:35.374615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:35.374719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:35.391142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:35.392297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:35.465783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 650/1297] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:35.504175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22926254-1444-4553-a440-3cc9097900b0 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:35.618897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22926254-1444-4553-a440-3cc9097900b0 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:35.652182 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=apM4bYklR3-yDYbBwE-ZTQ, audit_chain_id=['apM4bYklR3-yDYbBwE-ZTQ']) at 0x7fe8a15564c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:35.652966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:35.653277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:35.653542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] PATH_INFO: `/v3/services/placement` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:35.654187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:35.655566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:35.667123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:35.668808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:35.669893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:35.673135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 648/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:44:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:35.674855 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:35.769340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d223-0326-443a-95d9-15b9ccdbd539 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:35.803088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=apM4bYklR3-yDYbBwE-ZTQ, audit_chain_id=['apM4bYklR3-yDYbBwE-ZTQ']) at 0x7fe8a14f7940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:35.803745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:35.804028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:35.804305 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:35.805035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] RBAC: Adding query filter params (name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:35.805336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:35.806712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:35.812277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 651/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Fri May 13 12:44:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:35.819430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:35.927444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2a23b-8daa-4bd9-b425-788d7e99fecf None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:35.959326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=apM4bYklR3-yDYbBwE-ZTQ, audit_chain_id=['apM4bYklR3-yDYbBwE-ZTQ']) at 0x7fe8a14e45b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:35.959971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:35.960252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:35.960523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:35.961336 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] RBAC: Adding query filter params (interface=public, service_id=8ab21dbdf23f4e239c76bc7f5e9cd9a9, region_id=RegionOne) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:35.961643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:35.962996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03c384-ad9d-4947-b6c5-99cb2347a4ef None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:35.968962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 649/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Fri May 13 12:44:35 2022] GET /identity/v3/endpoints?service_id=8ab21dbdf23f4e239c76bc7f5e9cd9a9&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:35.974399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:36.071493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf32e8-7be7-4214-84b0-b49eb9a4860d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:36.106012 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd369e33-4964-401a-a3fb-9e45425fbd2c None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=apM4bYklR3-yDYbBwE-ZTQ, audit_chain_id=['apM4bYklR3-yDYbBwE-ZTQ']) at 0x7fe8a13e8760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:36.106662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd369e33-4964-401a-a3fb-9e45425fbd2c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:36.106942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd369e33-4964-401a-a3fb-9e45425fbd2c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:36.107213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd369e33-4964-401a-a3fb-9e45425fbd2c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:36.107886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd369e33-4964-401a-a3fb-9e45425fbd2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:36.109272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd369e33-4964-401a-a3fb-9e45425fbd2c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:36.115898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 652/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Fri May 13 12:44:35 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:44:38.378893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f261b-0d5b-4811-a522-e8cbcefddfbc None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:38.379395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f261b-0d5b-4811-a522-e8cbcefddfbc None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:38.379395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f261b-0d5b-4811-a522-e8cbcefddfbc None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:38.380816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 650/1302] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:44:38.386800 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:38.387255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:38.387384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:38.403803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:44:38.404960 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:44:38.469222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 653/1303] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:44:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 13 12:44:38.492588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f261b-0d5b-4811-a522-e8cbcefddfbc None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:38.590391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f261b-0d5b-4811-a522-e8cbcefddfbc None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:38.623043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fsYYepwJRpio8B-wTZ2cVQ, audit_chain_id=['fsYYepwJRpio8B-wTZ2cVQ']) at 0x7fe8a1570be0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:38.623821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:38.624099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:38.624372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] PATH_INFO: `/v3/services/placement` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:38.625041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:38.626395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application Traceback (most recent call last): May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 13 12:44:38.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._get_service(service_id) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 13 12:44:38.639227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.get_or_create( May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application with Lock( May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self._enter() May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application return self.creator() May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application created_value = creator( May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: ERROR keystone.server.flask.application May 13 12:44:38.640177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 651/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Fri May 13 12:44:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 13 12:44:38.645571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:38.744971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93164c-1dc6-410e-b158-6273f1008da5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:38.779439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fsYYepwJRpio8B-wTZ2cVQ, audit_chain_id=['fsYYepwJRpio8B-wTZ2cVQ']) at 0x7fe8a187de20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:38.780083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:38.780355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:38.780622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:38.781345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:44:38.781640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:38.783004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53885c98-fdd5-4e2e-9b12-052fe907d928 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:38.787973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 654/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Fri May 13 12:44:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:44:38.794527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:44:38.892699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716fc5a0-9581-46b2-8107-51afed604c4a None admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:44:38.925748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1b1b0a-a238-452d-911d-c4243d257f34 None admin] RBAC: auth_context: {'token': <TokenModel (audit_id=fsYYepwJRpio8B-wTZ2cVQ, audit_chain_id=['fsYYepwJRpio8B-wTZ2cVQ']) at 0x7fe8a14e9220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:44:38.926390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1b0a-a238-452d-911d-c4243d257f34 None admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:44:38.926667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1b0a-a238-452d-911d-c4243d257f34 None admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:44:38.926936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1b1b0a-a238-452d-911d-c4243d257f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:44:38.927655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b1b0a-a238-452d-911d-c4243d257f34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:44:38.929016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1b1b0a-a238-452d-911d-c4243d257f34 None admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:44:38.946814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 652/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Fri May 13 12:44:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:45:44.572206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ed61-5dbf-4132-b66b-8d62e36582ea None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:44.573265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ed61-5dbf-4132-b66b-8d62e36582ea None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:44.573774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24ed61-5dbf-4132-b66b-8d62e36582ea None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:44.581556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e53f-aa4b-4a5b-9e47-05c8ef3a88af None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:44.582447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e53f-aa4b-4a5b-9e47-05c8ef3a88af None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:44.582940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881e53f-aa4b-4a5b-9e47-05c8ef3a88af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:44.585241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 655/1307] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:45:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:45:44.672564 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b881e53f-aa4b-4a5b-9e47-05c8ef3a88af None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:45:44.674824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b881e53f-aa4b-4a5b-9e47-05c8ef3a88af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:44.901653 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 653/1308] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:45:44.919757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ea971-c8ea-4f58-a826-e5bf7d1869fe None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:44.920474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ea971-c8ea-4f58-a826-e5bf7d1869fe None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:44.921360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ea971-c8ea-4f58-a826-e5bf7d1869fe None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:44.925623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 656/1309] 10.222.0.49 () {54 vars in 964 bytes} [Fri May 13 12:45:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:45:44.931313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8988f-7488-4457-a9bd-3ecd2bc1ddff None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:44.931610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8988f-7488-4457-a9bd-3ecd2bc1ddff None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:44.931914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8988f-7488-4457-a9bd-3ecd2bc1ddff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:45.054101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-34d8988f-7488-4457-a9bd-3ecd2bc1ddff None None] MFA Rules not processed for user `40efb0126116472aabce8459ff59bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:45:45.055317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-34d8988f-7488-4457-a9bd-3ecd2bc1ddff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:45.135469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 654/1310] 10.222.0.49 () {58 vars in 1061 bytes} [Fri May 13 12:45:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:45:45.146451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ea971-c8ea-4f58-a826-e5bf7d1869fe None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:45:45.148264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a16ea971-c8ea-4f58-a826-e5bf7d1869fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:45.264687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ea971-c8ea-4f58-a826-e5bf7d1869fe None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:45:45.344183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1841d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:45:45.344838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:45.345159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:45.345429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:45.347309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:45.459671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:45:45.461144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8239eb01-3592-4e37-be22-991fce46d545 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:45:45.480279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 657/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:45:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:45:48.038334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec915c0-1ca5-4401-b5e5-14f7d263b1f7 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:48.038866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec915c0-1ca5-4401-b5e5-14f7d263b1f7 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:48.038866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec915c0-1ca5-4401-b5e5-14f7d263b1f7 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:48.040335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 655/1312] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:45:48.045942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905afe8-12ba-4083-a48a-f75ba838a062 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:48.046407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905afe8-12ba-4083-a48a-f75ba838a062 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:48.046499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905afe8-12ba-4083-a48a-f75ba838a062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:48.134788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e905afe8-12ba-4083-a48a-f75ba838a062 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:45:48.136805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e905afe8-12ba-4083-a48a-f75ba838a062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:48.252719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 658/1313] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:45:48.302101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec915c0-1ca5-4401-b5e5-14f7d263b1f7 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:45:48.303663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2ec915c0-1ca5-4401-b5e5-14f7d263b1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:48.414665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec915c0-1ca5-4401-b5e5-14f7d263b1f7 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:45:48.500019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a160c1f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:45:48.500677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:48.500961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:48.502272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:48.504191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:48.640284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:45:48.641770 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5114eaf9-d84c-4574-a8d9-9ade8fc1590d service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:45:48.662247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 656/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:45:51.343638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd120-b5d4-49ad-a134-cff62f92fab1 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:51.344201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd120-b5d4-49ad-a134-cff62f92fab1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:51.344201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19fd120-b5d4-49ad-a134-cff62f92fab1 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:51.346198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 659/1315] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:45:51.351891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7cb27-17e9-48e6-ba03-5aa9a8fcc422 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:51.352353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7cb27-17e9-48e6-ba03-5aa9a8fcc422 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:51.352447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7cb27-17e9-48e6-ba03-5aa9a8fcc422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:51.419402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-fba7cb27-17e9-48e6-ba03-5aa9a8fcc422 None None] MFA Rules not processed for user `bb55de117ea24c3f87df0a228e17033a`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:45:51.420614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-fba7cb27-17e9-48e6-ba03-5aa9a8fcc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:51.523934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 657/1316] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:45:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:45:51.565483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd120-b5d4-49ad-a134-cff62f92fab1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:45:51.567008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d19fd120-b5d4-49ad-a134-cff62f92fab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:51.669571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19fd120-b5d4-49ad-a134-cff62f92fab1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:45:51.741779 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1468eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:45:51.742423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:51.742702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:51.742973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:51.744612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:51.851520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:45:51.852949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001c28cc-2e0a-4a0b-a4e6-afd60aad1211 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:45:51.871724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 660/1317] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:45:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:45:54.714689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce0c89-6962-48dd-a180-b4b5b34c6aad None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:54.715213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce0c89-6962-48dd-a180-b4b5b34c6aad None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:54.715213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce0c89-6962-48dd-a180-b4b5b34c6aad None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:54.716729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 658/1318] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:45:54.722240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadafc0-0616-4433-b407-6165cf70c6c6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:54.722629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadafc0-0616-4433-b407-6165cf70c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:54.722788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cadafc0-0616-4433-b407-6165cf70c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:54.785787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8cadafc0-0616-4433-b407-6165cf70c6c6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:45:54.786969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8cadafc0-0616-4433-b407-6165cf70c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:54.894205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 661/1319] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:45:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:45:54.933683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce0c89-6962-48dd-a180-b4b5b34c6aad None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:45:54.935211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e7ce0c89-6962-48dd-a180-b4b5b34c6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:55.035251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce0c89-6962-48dd-a180-b4b5b34c6aad None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:45:55.104093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a14b40a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:45:55.104730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:55.105027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:55.105302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:55.106916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:55.215341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:45:55.216731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2b43a-613c-4449-bff1-d071390cb2ea service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:45:55.238983 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 659/1320] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:45:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:45:58.255953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a19a7-958d-42e0-8293-31148c9cb4df None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:58.256478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a19a7-958d-42e0-8293-31148c9cb4df None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:58.256478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a19a7-958d-42e0-8293-31148c9cb4df None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:58.257805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 662/1321] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:45:58.263170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea9449-050b-46c0-a04d-90dea3c6f467 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:58.263616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea9449-050b-46c0-a04d-90dea3c6f467 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:58.263859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea9449-050b-46c0-a04d-90dea3c6f467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:58.329939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b7ea9449-050b-46c0-a04d-90dea3c6f467 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:45:58.331154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b7ea9449-050b-46c0-a04d-90dea3c6f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:58.429962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 660/1322] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:45:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:45:58.465223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a19a7-958d-42e0-8293-31148c9cb4df None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:45:58.466737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b50a19a7-958d-42e0-8293-31148c9cb4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:58.569354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a19a7-958d-42e0-8293-31148c9cb4df None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:45:58.641111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1541fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:45:58.641764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:45:58.642048 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:45:58.642294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:45:58.643988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:45:58.750352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:45:58.751934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9289ed-7c32-4a30-b34f-ca1b37e5027d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:45:58.770218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 663/1323] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:45:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:01.165739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b1b2-4460-4a8e-8b7d-26a9c712ed25 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:01.166271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b1b2-4460-4a8e-8b7d-26a9c712ed25 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:01.166271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3b1b2-4460-4a8e-8b7d-26a9c712ed25 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:01.167976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 661/1324] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:01.173828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a8f9-ec03-4516-9c60-a02672d3c7b3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:01.181113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a8f9-ec03-4516-9c60-a02672d3c7b3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:01.181113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4a8f9-ec03-4516-9c60-a02672d3c7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:01.242405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-09b4a8f9-ec03-4516-9c60-a02672d3c7b3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:01.243678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-09b4a8f9-ec03-4516-9c60-a02672d3c7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:01.339595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 664/1325] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:01.375802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b1b2-4460-4a8e-8b7d-26a9c712ed25 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:01.377498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-33f3b1b2-4460-4a8e-8b7d-26a9c712ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:01.486659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3b1b2-4460-4a8e-8b7d-26a9c712ed25 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:01.559835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1143a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:01.560292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:01.560569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:01.560837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:01.562519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:01.680786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:01.682271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317d2f0-70ed-4148-9cd9-fcdd3451690d service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:01.711910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 662/1326] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:04.052489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981952a-4669-4cd0-9091-234f9ca53377 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:04.053099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981952a-4669-4cd0-9091-234f9ca53377 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:04.053099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8981952a-4669-4cd0-9091-234f9ca53377 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:04.054495 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 665/1327] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:04.059838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afeea3-ecd5-4828-b6de-d07a26f782cb None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:04.060265 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afeea3-ecd5-4828-b6de-d07a26f782cb None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:04.060520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04afeea3-ecd5-4828-b6de-d07a26f782cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:04.126153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-04afeea3-ecd5-4828-b6de-d07a26f782cb None None] MFA Rules not processed for user `bb55de117ea24c3f87df0a228e17033a`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:04.126924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-04afeea3-ecd5-4828-b6de-d07a26f782cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:04.223150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 663/1328] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:04.277286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887ce35-f6a5-4c49-87f1-c9fc74d5668a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:04.277575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887ce35-f6a5-4c49-87f1-c9fc74d5668a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:04.277851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887ce35-f6a5-4c49-87f1-c9fc74d5668a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:04.279222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 666/1329] 10.222.0.49 () {54 vars in 964 bytes} [Fri May 13 12:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:46:04.285851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b013-ed63-4e6e-92fa-dee4e1f6702b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:04.286151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b013-ed63-4e6e-92fa-dee4e1f6702b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:04.286431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b0b013-ed63-4e6e-92fa-dee4e1f6702b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:04.362897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-96b0b013-ed63-4e6e-92fa-dee4e1f6702b None None] MFA Rules not processed for user `40efb0126116472aabce8459ff59bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:04.364096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-96b0b013-ed63-4e6e-92fa-dee4e1f6702b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:04.441786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 664/1330] 10.222.0.49 () {58 vars in 1061 bytes} [Fri May 13 12:46:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:04.450995 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887ce35-f6a5-4c49-87f1-c9fc74d5668a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:04.452929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d887ce35-f6a5-4c49-87f1-c9fc74d5668a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:04.557848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887ce35-f6a5-4c49-87f1-c9fc74d5668a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:04.628837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a14ffd30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:04.629503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:04.629790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:04.630049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:04.631671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:04.737901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:04.739328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528b424-83ff-4bea-84f8-35d7caa0f791 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:04.757341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 667/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:07.666660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c31fef-91e6-4394-a0da-2e4ba3bba1f6 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:07.667209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c31fef-91e6-4394-a0da-2e4ba3bba1f6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:07.667209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c31fef-91e6-4394-a0da-2e4ba3bba1f6 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:07.668571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 665/1332] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:07.674467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7a83-689d-4fbd-aca9-030b54f7d62d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:07.674912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7a83-689d-4fbd-aca9-030b54f7d62d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:07.675014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d7a83-689d-4fbd-aca9-030b54f7d62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:07.748224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-543d7a83-689d-4fbd-aca9-030b54f7d62d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:07.749497 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-543d7a83-689d-4fbd-aca9-030b54f7d62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:07.859880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 668/1333] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:07.896826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c31fef-91e6-4394-a0da-2e4ba3bba1f6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:07.898419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-11c31fef-91e6-4394-a0da-2e4ba3bba1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:08.016930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c31fef-91e6-4394-a0da-2e4ba3bba1f6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:08.101468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1556bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:08.102124 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:08.102398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:08.102664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:08.104326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:08.222121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:08.224707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404957b9-7e05-4e81-b7f8-2123e067f26b service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:08.248443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 666/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:10.650024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b2b2-3e87-44fd-95b7-0958bfd77fe9 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:10.650530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b2b2-3e87-44fd-95b7-0958bfd77fe9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:10.650711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223b2b2-3e87-44fd-95b7-0958bfd77fe9 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:10.651943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 669/1335] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:46:10.660968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b250182-a8a4-4309-9f52-a9d1b751444e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:10.661712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b250182-a8a4-4309-9f52-a9d1b751444e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:10.661984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b250182-a8a4-4309-9f52-a9d1b751444e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:10.744263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6b250182-a8a4-4309-9f52-a9d1b751444e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:10.745519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6b250182-a8a4-4309-9f52-a9d1b751444e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:10.853514 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 667/1336] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:10.895116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223b2b2-3e87-44fd-95b7-0958bfd77fe9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:10.896691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c223b2b2-3e87-44fd-95b7-0958bfd77fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:11.004676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223b2b2-3e87-44fd-95b7-0958bfd77fe9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:11.086761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a14e2910>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:11.087412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:11.087705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:11.092088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:11.092088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:11.202019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:11.204631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f72a84-e53a-4c73-bde4-f01e2962383c service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:11.223939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 670/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:14.015061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574eb5b-6464-4259-8aee-13cbcf389cb5 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:14.016134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574eb5b-6464-4259-8aee-13cbcf389cb5 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:14.016242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574eb5b-6464-4259-8aee-13cbcf389cb5 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:14.017779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 668/1338] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:14.023118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6fb4c-16d1-4760-8ced-dc6ded68e45b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:14.023529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6fb4c-16d1-4760-8ced-dc6ded68e45b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:14.023658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6fb4c-16d1-4760-8ced-dc6ded68e45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:14.087876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8cb6fb4c-16d1-4760-8ced-dc6ded68e45b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:14.089189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8cb6fb4c-16d1-4760-8ced-dc6ded68e45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:14.184010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 671/1339] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:14.221480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574eb5b-6464-4259-8aee-13cbcf389cb5 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:14.223211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7574eb5b-6464-4259-8aee-13cbcf389cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:14.328720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574eb5b-6464-4259-8aee-13cbcf389cb5 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:14.403172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a160eb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:14.403813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:14.404089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:14.404357 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:14.406020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:14.512465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:14.513822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb479b-6d5e-4452-a3a9-ecef9211cb7e service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:14.531188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 669/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:14 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:18.993204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff6ccc-b858-43ff-a639-d55a3ad99d4a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:18.993736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff6ccc-b858-43ff-a639-d55a3ad99d4a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:18.993736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff6ccc-b858-43ff-a639-d55a3ad99d4a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:18.995199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 672/1341] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:46:19.001191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d99558-5510-489b-b666-a120d8566e57 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:19.001680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d99558-5510-489b-b666-a120d8566e57 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:19.001799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d99558-5510-489b-b666-a120d8566e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:19.081137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-60d99558-5510-489b-b666-a120d8566e57 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:19.082243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-60d99558-5510-489b-b666-a120d8566e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:19.214970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 670/1342] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:19.262755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff6ccc-b858-43ff-a639-d55a3ad99d4a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:19.265109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-23ff6ccc-b858-43ff-a639-d55a3ad99d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:19.375737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff6ccc-b858-43ff-a639-d55a3ad99d4a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:19.378739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf224c-860a-4fc8-8c2a-97011c8da63d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a134e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:19.379395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf224c-860a-4fc8-8c2a-97011c8da63d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:19.379671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf224c-860a-4fc8-8c2a-97011c8da63d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:19.379941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf224c-860a-4fc8-8c2a-97011c8da63d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:19.390181 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf224c-860a-4fc8-8c2a-97011c8da63d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:19.391951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf224c-860a-4fc8-8c2a-97011c8da63d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:19.402807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 673/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:22.355222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ace70-e20e-4670-8bc4-21b500175233 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:22.355738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ace70-e20e-4670-8bc4-21b500175233 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:22.355738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967ace70-e20e-4670-8bc4-21b500175233 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:22.357037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 671/1344] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:22.363370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e359-51c4-48b3-b584-fd368f55b040 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:22.363871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e359-51c4-48b3-b584-fd368f55b040 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:22.364030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072e359-51c4-48b3-b584-fd368f55b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:22.393681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c072e359-51c4-48b3-b584-fd368f55b040 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:22.395131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c072e359-51c4-48b3-b584-fd368f55b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:22.477611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 674/1345] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:22.517067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ace70-e20e-4670-8bc4-21b500175233 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:22.518900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-967ace70-e20e-4670-8bc4-21b500175233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:22.532788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967ace70-e20e-4670-8bc4-21b500175233 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:22.539594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b534a4b-b985-4397-931f-e68fd5529527 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a14fba00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:22.540252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534a4b-b985-4397-931f-e68fd5529527 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:22.540531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534a4b-b985-4397-931f-e68fd5529527 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:22.540797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b534a4b-b985-4397-931f-e68fd5529527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:22.551111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534a4b-b985-4397-931f-e68fd5529527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:22.552545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b534a4b-b985-4397-931f-e68fd5529527 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:22.562419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 672/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:27.109543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4605a3-5082-4d2c-8bbf-de4e475b50a8 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:27.110070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4605a3-5082-4d2c-8bbf-de4e475b50a8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:27.110070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4605a3-5082-4d2c-8bbf-de4e475b50a8 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:27.111516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 675/1347] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:27.116753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616385e-8ed0-4c8c-b00f-4dc90434bdad None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:27.117214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616385e-8ed0-4c8c-b00f-4dc90434bdad None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:27.117340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616385e-8ed0-4c8c-b00f-4dc90434bdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:27.135176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5616385e-8ed0-4c8c-b00f-4dc90434bdad None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:27.136355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5616385e-8ed0-4c8c-b00f-4dc90434bdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:27.145230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 673/1348] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:27.181932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4605a3-5082-4d2c-8bbf-de4e475b50a8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:27.193089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4605a3-5082-4d2c-8bbf-de4e475b50a8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:27.196574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac0d15-17d0-4835-85e2-08ab42263448 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1338670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:27.197234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0d15-17d0-4835-85e2-08ab42263448 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:27.197523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0d15-17d0-4835-85e2-08ab42263448 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:27.197798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac0d15-17d0-4835-85e2-08ab42263448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:27.207387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac0d15-17d0-4835-85e2-08ab42263448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:27.208817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac0d15-17d0-4835-85e2-08ab42263448 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:27.218377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 676/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:32.783872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811cf97-7f97-4240-af02-89e5bbb7c54d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:32.784759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811cf97-7f97-4240-af02-89e5bbb7c54d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:32.785232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811cf97-7f97-4240-af02-89e5bbb7c54d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:32.787072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 674/1350] 10.222.0.49 () {54 vars in 921 bytes} [Fri May 13 12:46:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:32.792655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5eb02-e935-4d31-91d0-29c9700d63d9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:32.793526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5eb02-e935-4d31-91d0-29c9700d63d9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:32.793974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5eb02-e935-4d31-91d0-29c9700d63d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:32.887978 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9ca5eb02-e935-4d31-91d0-29c9700d63d9 None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:32.891274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9ca5eb02-e935-4d31-91d0-29c9700d63d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:33.037088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 677/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Fri May 13 12:46:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:37.179488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926164b-30de-4155-963f-0c54d9083c1b None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:37.180321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926164b-30de-4155-963f-0c54d9083c1b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:37.180853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926164b-30de-4155-963f-0c54d9083c1b None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:37.182337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 675/1352] 10.222.0.49 () {54 vars in 921 bytes} [Fri May 13 12:46:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:37.187858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46650c84-5170-4f1a-a8fe-52902c6557a1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:37.188683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46650c84-5170-4f1a-a8fe-52902c6557a1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:37.189215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46650c84-5170-4f1a-a8fe-52902c6557a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:37.207659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-46650c84-5170-4f1a-a8fe-52902c6557a1 None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:37.209166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-46650c84-5170-4f1a-a8fe-52902c6557a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:37.219080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 678/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Fri May 13 12:46:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:38.989503 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380eee6-abdd-420e-9180-7ce37b3ce58e None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:38.990017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380eee6-abdd-420e-9180-7ce37b3ce58e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:38.990108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380eee6-abdd-420e-9180-7ce37b3ce58e None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:38.991431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 676/1354] 10.222.0.49 () {54 vars in 921 bytes} [Fri May 13 12:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:38.997212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b22bd-a6d5-419b-96db-4cd38cd60f05 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:38.997675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b22bd-a6d5-419b-96db-4cd38cd60f05 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:38.997768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b22bd-a6d5-419b-96db-4cd38cd60f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:39.015725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b42b22bd-a6d5-419b-96db-4cd38cd60f05 None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:39.016923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b42b22bd-a6d5-419b-96db-4cd38cd60f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:39.026020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 679/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Fri May 13 12:46:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:42.962318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5bb8-9622-479e-886f-bbf29dd4a743 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:42.962908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5bb8-9622-479e-886f-bbf29dd4a743 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:42.962908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eff5bb8-9622-479e-886f-bbf29dd4a743 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:42.971513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 677/1356] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:42.973115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31581e1-e4b7-4844-b4ed-d3abbb3f685b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:42.976188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31581e1-e4b7-4844-b4ed-d3abbb3f685b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:42.976478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31581e1-e4b7-4844-b4ed-d3abbb3f685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:42.996319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b31581e1-e4b7-4844-b4ed-d3abbb3f685b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:42.998211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b31581e1-e4b7-4844-b4ed-d3abbb3f685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:43.008776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 680/1357] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:43.057860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550d14-035c-4118-8b41-ef11148b09c1 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:43.058223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550d14-035c-4118-8b41-ef11148b09c1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:43.058568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550d14-035c-4118-8b41-ef11148b09c1 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:43.060036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 678/1358] 10.222.0.49 () {54 vars in 961 bytes} [Fri May 13 12:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:43.065727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca85f4-a986-45fe-b273-34c6b4831e38 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:43.066105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca85f4-a986-45fe-b273-34c6b4831e38 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:43.066457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca85f4-a986-45fe-b273-34c6b4831e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:43.117179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2dca85f4-a986-45fe-b273-34c6b4831e38 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:43.118680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2dca85f4-a986-45fe-b273-34c6b4831e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:43.201603 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 681/1359] 10.222.0.49 () {58 vars in 1058 bytes} [Fri May 13 12:46:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:43.209547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec550d14-035c-4118-8b41-ef11148b09c1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:43.226711 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec550d14-035c-4118-8b41-ef11148b09c1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:43.232259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a77f86-8e76-42a9-b269-0e51a6a611e4 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a117f250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:43.233708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77f86-8e76-42a9-b269-0e51a6a611e4 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:43.234032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77f86-8e76-42a9-b269-0e51a6a611e4 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:43.234492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a77f86-8e76-42a9-b269-0e51a6a611e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:43.243782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a77f86-8e76-42a9-b269-0e51a6a611e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:43.245399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a77f86-8e76-42a9-b269-0e51a6a611e4 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:43.255629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 679/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:45.833874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c829a-e3cc-428f-83ba-7ae33391c3ec None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:45.834412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c829a-e3cc-428f-83ba-7ae33391c3ec None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:45.834412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c829a-e3cc-428f-83ba-7ae33391c3ec None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:45.835968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 682/1361] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:46:45.841427 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc90fd-2058-4e77-93a3-7686f286e33e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:45.841909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc90fd-2058-4e77-93a3-7686f286e33e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:45.841987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bc90fd-2058-4e77-93a3-7686f286e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:45.872222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-22bc90fd-2058-4e77-93a3-7686f286e33e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:45.874042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-22bc90fd-2058-4e77-93a3-7686f286e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:45.886813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 680/1362] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:45.934710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c829a-e3cc-428f-83ba-7ae33391c3ec None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:45.950401 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c829a-e3cc-428f-83ba-7ae33391c3ec None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:45.957066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3d949-3647-4bb8-aadf-977f8b132a2c service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a1549b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:45.957725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3d949-3647-4bb8-aadf-977f8b132a2c service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:45.958255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3d949-3647-4bb8-aadf-977f8b132a2c service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:45.959072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3d949-3647-4bb8-aadf-977f8b132a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:45.981458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3d949-3647-4bb8-aadf-977f8b132a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:45.983656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3d949-3647-4bb8-aadf-977f8b132a2c service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:45.995894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 683/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:48.700813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e6a6-9407-4f38-b60b-a96cb621b17c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:48.701447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e6a6-9407-4f38-b60b-a96cb621b17c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:48.701447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314e6a6-9407-4f38-b60b-a96cb621b17c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:48.703840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 681/1364] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:48.709259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ae0f-f791-4c78-8a8e-38eadce54173 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:48.709773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ae0f-f791-4c78-8a8e-38eadce54173 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:48.709874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b37ae0f-f791-4c78-8a8e-38eadce54173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:48.728136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1b37ae0f-f791-4c78-8a8e-38eadce54173 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:48.729424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1b37ae0f-f791-4c78-8a8e-38eadce54173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:48.739549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 684/1365] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:48.786363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd148bd-2bd1-4260-9500-f8505e02eddb None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:48.786965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd148bd-2bd1-4260-9500-f8505e02eddb None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:48.787383 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd148bd-2bd1-4260-9500-f8505e02eddb None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:48.789644 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 682/1366] 10.222.0.49 () {54 vars in 961 bytes} [Fri May 13 12:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:46:48.795553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c00f8-9dc2-40cc-bf76-e65f2a2197a7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:48.795832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c00f8-9dc2-40cc-bf76-e65f2a2197a7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:48.796102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88c00f8-9dc2-40cc-bf76-e65f2a2197a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:48.826097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f88c00f8-9dc2-40cc-bf76-e65f2a2197a7 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:48.828137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f88c00f8-9dc2-40cc-bf76-e65f2a2197a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:48.838265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 685/1367] 10.222.0.49 () {58 vars in 1058 bytes} [Fri May 13 12:46:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:48.847139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd148bd-2bd1-4260-9500-f8505e02eddb None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:48.863122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd148bd-2bd1-4260-9500-f8505e02eddb None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:48.869418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590cd76e-ae93-4fc4-b6c2-4f0c62af78ff service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a155a160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:48.870098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd76e-ae93-4fc4-b6c2-4f0c62af78ff service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:48.870410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd76e-ae93-4fc4-b6c2-4f0c62af78ff service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:48.870684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590cd76e-ae93-4fc4-b6c2-4f0c62af78ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:48.880444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cd76e-ae93-4fc4-b6c2-4f0c62af78ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:48.882055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590cd76e-ae93-4fc4-b6c2-4f0c62af78ff service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:48.893104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 683/1368] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:51.361069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ec8b-d0c3-4776-aa06-1710a6fa139e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.361694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ec8b-d0c3-4776-aa06-1710a6fa139e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.361694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7ec8b-d0c3-4776-aa06-1710a6fa139e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:51.362901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 686/1369] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:51.368609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f7cc-852c-4ba2-82f1-1b598250610e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.369098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f7cc-852c-4ba2-82f1-1b598250610e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.369206 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0f7cc-852c-4ba2-82f1-1b598250610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:51.395643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-8fe0f7cc-852c-4ba2-82f1-1b598250610e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:51.396910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8fe0f7cc-852c-4ba2-82f1-1b598250610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:51.407254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 684/1370] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:51.452692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ec8b-d0c3-4776-aa06-1710a6fa139e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:51.470874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7ec8b-d0c3-4776-aa06-1710a6fa139e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:51.477637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc05e6-5183-4cd4-bec4-7145a30024d4 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a1554970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:51.478742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc05e6-5183-4cd4-bec4-7145a30024d4 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.479144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc05e6-5183-4cd4-bec4-7145a30024d4 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.479581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc05e6-5183-4cd4-bec4-7145a30024d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:51.491328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc05e6-5183-4cd4-bec4-7145a30024d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:51.494047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc05e6-5183-4cd4-bec4-7145a30024d4 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:51.511431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 687/1371] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:51.590616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f216a6-e04f-4c30-a9f0-2a5578bea354 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.591168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f216a6-e04f-4c30-a9f0-2a5578bea354 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.591614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f216a6-e04f-4c30-a9f0-2a5578bea354 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:51.593688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 685/1372] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:51.599890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18867-bc1d-48a4-85b7-d1d3c377ed56 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.600601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18867-bc1d-48a4-85b7-d1d3c377ed56 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.601061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af18867-bc1d-48a4-85b7-d1d3c377ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:51.628548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0af18867-bc1d-48a4-85b7-d1d3c377ed56 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:51.628548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0af18867-bc1d-48a4-85b7-d1d3c377ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:51.649040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 688/1373] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:51.974293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ab3c-814b-4832-968f-67b5b0b0ce52 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.974293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ab3c-814b-4832-968f-67b5b0b0ce52 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.974293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072ab3c-814b-4832-968f-67b5b0b0ce52 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:51.974293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 686/1374] 10.222.0.49 () {54 vars in 963 bytes} [Fri May 13 12:46:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:51.981384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dfd5f-5168-4bb6-af79-71f08e0a0512 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:51.981493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dfd5f-5168-4bb6-af79-71f08e0a0512 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:51.981876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dfd5f-5168-4bb6-af79-71f08e0a0512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:52.039659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f73dfd5f-5168-4bb6-af79-71f08e0a0512 None None] MFA Rules not processed for user `eada5adaf6724be28208b8c7b0110e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:52.039659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f73dfd5f-5168-4bb6-af79-71f08e0a0512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:52.112262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 689/1375] 10.222.0.49 () {58 vars in 1060 bytes} [Fri May 13 12:46:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:52.120348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072ab3c-814b-4832-968f-67b5b0b0ce52 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:52.132911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072ab3c-814b-4832-968f-67b5b0b0ce52 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:52.136829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069df0c-1046-4829-bb16-3d14ac138667 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a1581040>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:52.137605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069df0c-1046-4829-bb16-3d14ac138667 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:52.137955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069df0c-1046-4829-bb16-3d14ac138667 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:52.138300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069df0c-1046-4829-bb16-3d14ac138667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:52.149618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069df0c-1046-4829-bb16-3d14ac138667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:52.151234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069df0c-1046-4829-bb16-3d14ac138667 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:52.161815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 687/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:53.899793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3e9e-0bd1-4680-a119-137d5ccc67ed None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:53.900374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3e9e-0bd1-4680-a119-137d5ccc67ed None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:53.900374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c3e9e-0bd1-4680-a119-137d5ccc67ed None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:53.901944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 690/1377] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:53.908679 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5a208-8122-44d4-936c-b19380f1d1a4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:53.909331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5a208-8122-44d4-936c-b19380f1d1a4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:53.909331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5a208-8122-44d4-936c-b19380f1d1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:53.929670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-14f5a208-8122-44d4-936c-b19380f1d1a4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:53.930928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-14f5a208-8122-44d4-936c-b19380f1d1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:53.939368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 688/1378] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:53.988330 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c3e9e-0bd1-4680-a119-137d5ccc67ed None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:54.003410 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c3e9e-0bd1-4680-a119-137d5ccc67ed None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:54.011578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ed9e6e-dd8d-49e8-acb0-47a898daf288 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a1434310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:54.012270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9e6e-dd8d-49e8-acb0-47a898daf288 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:54.012768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9e6e-dd8d-49e8-acb0-47a898daf288 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:54.013174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ed9e6e-dd8d-49e8-acb0-47a898daf288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:54.024521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed9e6e-dd8d-49e8-acb0-47a898daf288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:54.026441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ed9e6e-dd8d-49e8-acb0-47a898daf288 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:54.037589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 691/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:56.396191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092e01-812b-4b12-bc2e-d8caea6a7ca8 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:56.397109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092e01-812b-4b12-bc2e-d8caea6a7ca8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:56.397392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d092e01-812b-4b12-bc2e-d8caea6a7ca8 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:56.398757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 689/1380] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:56.404026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2078f4-2b0a-48b1-82a6-9b9077bce8ae None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:56.405138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2078f4-2b0a-48b1-82a6-9b9077bce8ae None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:56.405306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2078f4-2b0a-48b1-82a6-9b9077bce8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:56.423880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bc2078f4-2b0a-48b1-82a6-9b9077bce8ae None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:56.425102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bc2078f4-2b0a-48b1-82a6-9b9077bce8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:56.433357 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 692/1381] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:56.477886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d092e01-812b-4b12-bc2e-d8caea6a7ca8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:56.493064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d092e01-812b-4b12-bc2e-d8caea6a7ca8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:56.498731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420352ec-17b5-4fad-a7fb-b6d6b5461065 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a160cb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:56.499583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420352ec-17b5-4fad-a7fb-b6d6b5461065 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:56.499934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420352ec-17b5-4fad-a7fb-b6d6b5461065 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:56.500271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420352ec-17b5-4fad-a7fb-b6d6b5461065 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:56.509234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420352ec-17b5-4fad-a7fb-b6d6b5461065 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:56.510805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420352ec-17b5-4fad-a7fb-b6d6b5461065 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:56.522391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 690/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:46:58.848157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff1db-e142-4108-a591-d035ab45d3f0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:58.849794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff1db-e142-4108-a591-d035ab45d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:58.850444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff1db-e142-4108-a591-d035ab45d3f0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:58.852638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 693/1383] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:46:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:46:58.858163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d7de-9999-4f33-a54c-8884e55930f1 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:58.858670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d7de-9999-4f33-a54c-8884e55930f1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:58.858755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e1d7de-9999-4f33-a54c-8884e55930f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:58.878151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-96e1d7de-9999-4f33-a54c-8884e55930f1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:46:58.879425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-96e1d7de-9999-4f33-a54c-8884e55930f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:46:58.887831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 691/1384] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:46:58.931811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ff1db-e142-4108-a591-d035ab45d3f0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:46:58.947758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ff1db-e142-4108-a591-d035ab45d3f0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:46:58.953332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68260-eac5-411d-8418-54beef9dcf71 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a25a5820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:46:58.953996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68260-eac5-411d-8418-54beef9dcf71 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:46:58.954472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68260-eac5-411d-8418-54beef9dcf71 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:46:58.954753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68260-eac5-411d-8418-54beef9dcf71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:46:58.963543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68260-eac5-411d-8418-54beef9dcf71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:46:58.971946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68260-eac5-411d-8418-54beef9dcf71 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:46:58.984682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 694/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:46:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:01.572642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d15033-5e67-4fc6-9c0d-1aa1325b12ca None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:01.573240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d15033-5e67-4fc6-9c0d-1aa1325b12ca None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:01.573240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d15033-5e67-4fc6-9c0d-1aa1325b12ca None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:01.574618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 692/1386] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:01.582328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa97b-3099-41b6-b589-46a49c74a9d2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:01.582817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa97b-3099-41b6-b589-46a49c74a9d2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:01.582916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377aa97b-3099-41b6-b589-46a49c74a9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:01.601381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-377aa97b-3099-41b6-b589-46a49c74a9d2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:01.602583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-377aa97b-3099-41b6-b589-46a49c74a9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:01.611037 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 695/1387] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:01.655913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d15033-5e67-4fc6-9c0d-1aa1325b12ca None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:01.675537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d15033-5e67-4fc6-9c0d-1aa1325b12ca None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:01.682924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7673579-5a5d-41b1-9ca2-4559242a5721 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a120bb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:01.683780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7673579-5a5d-41b1-9ca2-4559242a5721 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:01.684112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7673579-5a5d-41b1-9ca2-4559242a5721 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:01.684471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7673579-5a5d-41b1-9ca2-4559242a5721 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:01.696855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7673579-5a5d-41b1-9ca2-4559242a5721 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:01.699179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7673579-5a5d-41b1-9ca2-4559242a5721 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:01.714273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 693/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:04.081990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823dc2c-5dd6-4366-bd3d-645c81aa7f5e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:04.082589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823dc2c-5dd6-4366-bd3d-645c81aa7f5e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:04.082889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823dc2c-5dd6-4366-bd3d-645c81aa7f5e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:04.084908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 696/1389] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:47:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:04.090570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0b4b1-d2e2-442e-b08b-e3564be195bc None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:04.091391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0b4b1-d2e2-442e-b08b-e3564be195bc None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:04.091391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0b4b1-d2e2-442e-b08b-e3564be195bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:04.116444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-69b0b4b1-d2e2-442e-b08b-e3564be195bc None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:04.118115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-69b0b4b1-d2e2-442e-b08b-e3564be195bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:04.130322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 694/1390] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:04.175349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823dc2c-5dd6-4366-bd3d-645c81aa7f5e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:04.193896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823dc2c-5dd6-4366-bd3d-645c81aa7f5e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:04.199447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036033fc-8baf-4cca-a3d4-24e42267e775 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a1579880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:04.200228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036033fc-8baf-4cca-a3d4-24e42267e775 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:04.200640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036033fc-8baf-4cca-a3d4-24e42267e775 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:04.201468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036033fc-8baf-4cca-a3d4-24e42267e775 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:04.210372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036033fc-8baf-4cca-a3d4-24e42267e775 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:04.211981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036033fc-8baf-4cca-a3d4-24e42267e775 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:04.222688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 697/1391] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:07.028553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f994-6f54-4e68-ac22-12529f2d5407 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:07.029787 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f994-6f54-4e68-ac22-12529f2d5407 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:07.029898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5f994-6f54-4e68-ac22-12529f2d5407 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:07.031509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 695/1392] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:07.036946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666276a-aca5-4ed4-9c41-170bb0cf1793 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:07.037428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666276a-aca5-4ed4-9c41-170bb0cf1793 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:07.037532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d666276a-aca5-4ed4-9c41-170bb0cf1793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:07.056009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d666276a-aca5-4ed4-9c41-170bb0cf1793 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:07.057242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d666276a-aca5-4ed4-9c41-170bb0cf1793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:07.065334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 698/1393] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:07.110984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f994-6f54-4e68-ac22-12529f2d5407 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:07.129104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5f994-6f54-4e68-ac22-12529f2d5407 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:07.136461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791e088-386e-4198-956f-81cde8e617fa service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a120bee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:07.137378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e088-386e-4198-956f-81cde8e617fa service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:07.137769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e088-386e-4198-956f-81cde8e617fa service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:07.138148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791e088-386e-4198-956f-81cde8e617fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:07.152411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791e088-386e-4198-956f-81cde8e617fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:07.156171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791e088-386e-4198-956f-81cde8e617fa service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:07.170470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 696/1394] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:08.376856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890176-ef0b-46a0-a6ac-f19dcfc9daad None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:08.377434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890176-ef0b-46a0-a6ac-f19dcfc9daad None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:08.377434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890176-ef0b-46a0-a6ac-f19dcfc9daad None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:08.378803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 699/1395] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:08.384153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242470-35dc-4794-ba02-22349b3661a3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:08.384630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242470-35dc-4794-ba02-22349b3661a3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:08.384740 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85242470-35dc-4794-ba02-22349b3661a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:08.403351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-85242470-35dc-4794-ba02-22349b3661a3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:08.405334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-85242470-35dc-4794-ba02-22349b3661a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:08.413199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 697/1396] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:08.470720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa027-0f57-43c1-88b4-2054d8592bdf None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:08.471026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa027-0f57-43c1-88b4-2054d8592bdf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:08.471297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa027-0f57-43c1-88b4-2054d8592bdf None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:08.472739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 700/1397] 10.222.0.49 () {54 vars in 962 bytes} [Fri May 13 12:47:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:08.479090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ecdab-842b-4308-92e3-b1a02668823e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:08.479469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ecdab-842b-4308-92e3-b1a02668823e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:08.479814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ecdab-842b-4308-92e3-b1a02668823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:08.531834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-017ecdab-842b-4308-92e3-b1a02668823e None None] MFA Rules not processed for user `296ed9d38ea741b1bc2c72fc398b5009`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:08.533107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-017ecdab-842b-4308-92e3-b1a02668823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:08.596869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 698/1398] 10.222.0.49 () {58 vars in 1059 bytes} [Fri May 13 12:47:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:08.604405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa027-0f57-43c1-88b4-2054d8592bdf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:08.615957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa027-0f57-43c1-88b4-2054d8592bdf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:08.619748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a412bb0-72d0-4227-a5e3-7f07dd310968 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=g_C7-r29Sf-wds4KLJUeQw, audit_chain_id=['g_C7-r29Sf-wds4KLJUeQw']) at 0x7fe8a17d3e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296ed9d38ea741b1bc2c72fc398b5009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:08.620389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a412bb0-72d0-4227-a5e3-7f07dd310968 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:08.620670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a412bb0-72d0-4227-a5e3-7f07dd310968 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:08.620939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a412bb0-72d0-4227-a5e3-7f07dd310968 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:08.630479 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a412bb0-72d0-4227-a5e3-7f07dd310968 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:08.631835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a412bb0-72d0-4227-a5e3-7f07dd310968 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:08.642411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 701/1399] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:09.102776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67673-b4bc-415a-a5e0-61d893134f20 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.103063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67673-b4bc-415a-a5e0-61d893134f20 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.103338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c67673-b4bc-415a-a5e0-61d893134f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.155917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-10c67673-b4bc-415a-a5e0-61d893134f20 None None] MFA Rules not processed for user `2efb260599b1451dba561f50c3f895e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:09.157208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-10c67673-b4bc-415a-a5e0-61d893134f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:09.224063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 699/1400] 10.222.0.49 () {58 vars in 1009 bytes} [Fri May 13 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:09.273100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63cef-8180-49a6-89d5-874460e1ed81 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.273478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63cef-8180-49a6-89d5-874460e1ed81 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.273817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e63cef-8180-49a6-89d5-874460e1ed81 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.275336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 702/1401] 10.222.0.49 () {54 vars in 942 bytes} [Fri May 13 12:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:09.283423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d192-d1ef-41a3-a16f-758f38537ffb None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.283736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d192-d1ef-41a3-a16f-758f38537ffb None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.284012 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2d192-d1ef-41a3-a16f-758f38537ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.335284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c2b2d192-d1ef-41a3-a16f-758f38537ffb None None] MFA Rules not processed for user `7f48f833629541c2bbc718c2372e1c1b`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:09.336465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c2b2d192-d1ef-41a3-a16f-758f38537ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:09.406659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 700/1402] 10.222.0.49 () {58 vars in 1039 bytes} [Fri May 13 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:09.415937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63cef-8180-49a6-89d5-874460e1ed81 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:09.430025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e63cef-8180-49a6-89d5-874460e1ed81 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:09.434897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734563a-df3a-4252-b0e8-73acb52709f6 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=4Tj8VH1kS-aTLtudxyItSA, audit_chain_id=['4Tj8VH1kS-aTLtudxyItSA']) at 0x7fe8a1549190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f48f833629541c2bbc718c2372e1c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:09.436354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734563a-df3a-4252-b0e8-73acb52709f6 service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.436638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734563a-df3a-4252-b0e8-73acb52709f6 service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.436910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734563a-df3a-4252-b0e8-73acb52709f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.444937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734563a-df3a-4252-b0e8-73acb52709f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:09.446566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734563a-df3a-4252-b0e8-73acb52709f6 service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:09.454650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 703/1403] 10.222.0.49 () {60 vars in 1384 bytes} [Fri May 13 12:47:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 12:47:09.466931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389346b2-07e0-427a-82e2-6bb24d87ca10 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.467327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389346b2-07e0-427a-82e2-6bb24d87ca10 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.467488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389346b2-07e0-427a-82e2-6bb24d87ca10 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.468837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 701/1404] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:09.474678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55a8e4-23e0-4c27-b64c-0df0ab48757d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.474908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55a8e4-23e0-4c27-b64c-0df0ab48757d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.475405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55a8e4-23e0-4c27-b64c-0df0ab48757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.493932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3d55a8e4-23e0-4c27-b64c-0df0ab48757d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:09.495130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3d55a8e4-23e0-4c27-b64c-0df0ab48757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:09.504095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 704/1405] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:09.559982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389346b2-07e0-427a-82e2-6bb24d87ca10 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:09.577470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389346b2-07e0-427a-82e2-6bb24d87ca10 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:09.583545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0c450-21b0-466a-865f-f0e1ff37e299 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a1570970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:09.584291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0c450-21b0-466a-865f-f0e1ff37e299 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:09.584643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0c450-21b0-466a-865f-f0e1ff37e299 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:09.585005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0c450-21b0-466a-865f-f0e1ff37e299 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:09.595842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0c450-21b0-466a-865f-f0e1ff37e299 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:09.597624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0c450-21b0-466a-865f-f0e1ff37e299 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:09.609023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 702/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:12.033849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba3b27-3cb0-498d-aad7-08c76e3d2b5e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:12.033849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba3b27-3cb0-498d-aad7-08c76e3d2b5e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:12.033849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ba3b27-3cb0-498d-aad7-08c76e3d2b5e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:12.033849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 705/1407] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:47:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:47:12.041424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8715-32af-42eb-8589-43c61233e358 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:12.041968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8715-32af-42eb-8589-43c61233e358 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:12.042083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d8715-32af-42eb-8589-43c61233e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:12.061349 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5d4d8715-32af-42eb-8589-43c61233e358 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:12.064552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5d4d8715-32af-42eb-8589-43c61233e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:12.073240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 703/1408] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:12.120541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba3b27-3cb0-498d-aad7-08c76e3d2b5e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:12.136868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ba3b27-3cb0-498d-aad7-08c76e3d2b5e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:12.146884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d51a7-6699-4451-9175-d2aaecdff42e service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a158c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:12.147644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d51a7-6699-4451-9175-d2aaecdff42e service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:12.147983 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d51a7-6699-4451-9175-d2aaecdff42e service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:12.148311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d51a7-6699-4451-9175-d2aaecdff42e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:12.166303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d51a7-6699-4451-9175-d2aaecdff42e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:12.168225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d51a7-6699-4451-9175-d2aaecdff42e service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:12.201194 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 706/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:33.261225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd43fd-d883-4805-a108-4d222ee41f97 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:33.261827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd43fd-d883-4805-a108-4d222ee41f97 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:33.261827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd43fd-d883-4805-a108-4d222ee41f97 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:33.263385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 704/1410] 10.222.0.49 () {54 vars in 918 bytes} [Fri May 13 12:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:33.269312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f45a-9210-4a02-a982-202c8773ba70 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:33.269770 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f45a-9210-4a02-a982-202c8773ba70 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:33.269871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f45a-9210-4a02-a982-202c8773ba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:33.287593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2579f45a-9210-4a02-a982-202c8773ba70 None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:33.288784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2579f45a-9210-4a02-a982-202c8773ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:33.298018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 707/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Fri May 13 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:33.313292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6919-7157-4c95-a15b-04c0565be46a None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:33.313577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6919-7157-4c95-a15b-04c0565be46a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:33.313851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d6919-7157-4c95-a15b-04c0565be46a None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:33.315195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 705/1412] 10.222.0.49 () {54 vars in 918 bytes} [Fri May 13 12:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:33.319982 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d0834-5fb5-413d-a528-508610e3c966 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:33.320265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d0834-5fb5-413d-a528-508610e3c966 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:33.320542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3d0834-5fb5-413d-a528-508610e3c966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:33.338341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2b3d0834-5fb5-413d-a528-508610e3c966 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:33.339539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2b3d0834-5fb5-413d-a528-508610e3c966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:33.348659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 708/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Fri May 13 12:47:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:36.062006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567095c-77f9-46b7-9085-80e4377dd61d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:36.062571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567095c-77f9-46b7-9085-80e4377dd61d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:36.062571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5567095c-77f9-46b7-9085-80e4377dd61d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:36.063935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:36.069443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235f802-d82a-4b37-afe9-0309d5084b3b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:36.069846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235f802-d82a-4b37-afe9-0309d5084b3b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:36.070005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235f802-d82a-4b37-afe9-0309d5084b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:36.087950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6235f802-d82a-4b37-afe9-0309d5084b3b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:36.089171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6235f802-d82a-4b37-afe9-0309d5084b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:36.098230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:36.144559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567095c-77f9-46b7-9085-80e4377dd61d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:36.173104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5567095c-77f9-46b7-9085-80e4377dd61d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:36.179188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53617329-77d9-4f83-bc58-899a645db52d service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a1812940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:36.180089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617329-77d9-4f83-bc58-899a645db52d service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:36.180487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617329-77d9-4f83-bc58-899a645db52d service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:36.181024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53617329-77d9-4f83-bc58-899a645db52d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:36.190785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617329-77d9-4f83-bc58-899a645db52d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:36.193221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53617329-77d9-4f83-bc58-899a645db52d service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:36.204884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 707/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:37.215961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687b18e-ead8-4930-a7d3-d4c8c7ce8337 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:37.216529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687b18e-ead8-4930-a7d3-d4c8c7ce8337 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:37.216529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687b18e-ead8-4930-a7d3-d4c8c7ce8337 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:37.217865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:37.222993 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f15eb9-e917-438b-a774-060841f78025 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:37.223390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f15eb9-e917-438b-a774-060841f78025 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:37.223529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f15eb9-e917-438b-a774-060841f78025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:37.245533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-46f15eb9-e917-438b-a774-060841f78025 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:37.248225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-46f15eb9-e917-438b-a774-060841f78025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:37.257694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:37.426624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687b18e-ead8-4930-a7d3-d4c8c7ce8337 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:37.441007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687b18e-ead8-4930-a7d3-d4c8c7ce8337 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:37.446387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ddf7f-5fdd-4c04-be0c-8222cb2d8d4f service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a1507ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:37.447031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ddf7f-5fdd-4c04-be0c-8222cb2d8d4f service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:37.447312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ddf7f-5fdd-4c04-be0c-8222cb2d8d4f service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:37.447585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ddf7f-5fdd-4c04-be0c-8222cb2d8d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:37.456395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ddf7f-5fdd-4c04-be0c-8222cb2d8d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:37.458007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ddf7f-5fdd-4c04-be0c-8222cb2d8d4f service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:37.467826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 711/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:38.427637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7877ae-637c-4ec6-b9dd-b39ec7f22734 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:38.428188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7877ae-637c-4ec6-b9dd-b39ec7f22734 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:38.428188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7877ae-637c-4ec6-b9dd-b39ec7f22734 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:38.429605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:38.435118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d867ea4-991e-4fe4-97ed-ec8e01573220 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:38.435550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d867ea4-991e-4fe4-97ed-ec8e01573220 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:38.435646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d867ea4-991e-4fe4-97ed-ec8e01573220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:38.453611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4d867ea4-991e-4fe4-97ed-ec8e01573220 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:38.454793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4d867ea4-991e-4fe4-97ed-ec8e01573220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:38.462461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:38.615208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7877ae-637c-4ec6-b9dd-b39ec7f22734 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:38.629865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7877ae-637c-4ec6-b9dd-b39ec7f22734 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:38.635081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10410269-1172-43fb-832c-9f444ee5bada service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a1582640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:38.635705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10410269-1172-43fb-832c-9f444ee5bada service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:38.635981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10410269-1172-43fb-832c-9f444ee5bada service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:38.636249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10410269-1172-43fb-832c-9f444ee5bada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:38.644654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10410269-1172-43fb-832c-9f444ee5bada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:38.646276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10410269-1172-43fb-832c-9f444ee5bada service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:38.655391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 710/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:39.609929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfa2b5-03b1-4081-ab32-0dcde3150547 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:39.610471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfa2b5-03b1-4081-ab32-0dcde3150547 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:39.610471 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfa2b5-03b1-4081-ab32-0dcde3150547 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:39.611872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:39.616943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49802f-f7a9-407e-9fcd-f15dabedc018 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:39.617430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49802f-f7a9-407e-9fcd-f15dabedc018 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:39.617527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b49802f-f7a9-407e-9fcd-f15dabedc018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:39.638027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4b49802f-f7a9-407e-9fcd-f15dabedc018 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:39.639221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4b49802f-f7a9-407e-9fcd-f15dabedc018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:39.647801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:39.798629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfa2b5-03b1-4081-ab32-0dcde3150547 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:39.813242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfa2b5-03b1-4081-ab32-0dcde3150547 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:39.818530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93e921d-9fe8-4223-ad4d-ccf9282a9719 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=laTDTs8zTBOMm8gSCHX22A, audit_chain_id=['laTDTs8zTBOMm8gSCHX22A']) at 0x7fe8a25a5550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:39.819158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e921d-9fe8-4223-ad4d-ccf9282a9719 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:39.819437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e921d-9fe8-4223-ad4d-ccf9282a9719 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:39.819708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93e921d-9fe8-4223-ad4d-ccf9282a9719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:39.829016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e921d-9fe8-4223-ad4d-ccf9282a9719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:39.830610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93e921d-9fe8-4223-ad4d-ccf9282a9719 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:39.840096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 714/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:40.782645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234555b0-718a-41c4-8e18-e67820b4d860 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:40.783223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234555b0-718a-41c4-8e18-e67820b4d860 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:40.783223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234555b0-718a-41c4-8e18-e67820b4d860 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:40.784547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:40.789735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5e0b-4603-49bb-9a44-2ac055e4a2d0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:40.790134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5e0b-4603-49bb-9a44-2ac055e4a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:40.790286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5e0b-4603-49bb-9a44-2ac055e4a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:40.808785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f3af5e0b-4603-49bb-9a44-2ac055e4a2d0 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:40.811235 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f3af5e0b-4603-49bb-9a44-2ac055e4a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:40.819253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:40.975856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234555b0-718a-41c4-8e18-e67820b4d860 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:40.990528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234555b0-718a-41c4-8e18-e67820b4d860 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:40.995906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e3e55-1d2d-4038-a802-f1908dca0c62 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a14e4220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:40.997353 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e3e55-1d2d-4038-a802-f1908dca0c62 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:40.997757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e3e55-1d2d-4038-a802-f1908dca0c62 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:40.998028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e3e55-1d2d-4038-a802-f1908dca0c62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:41.006293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e3e55-1d2d-4038-a802-f1908dca0c62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:41.007875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e3e55-1d2d-4038-a802-f1908dca0c62 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:41.017309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 713/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:41.902033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e2e92-8881-41fb-a849-4cca109f7903 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:41.903113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e2e92-8881-41fb-a849-4cca109f7903 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:41.903213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e2e92-8881-41fb-a849-4cca109f7903 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:41.904779 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:41.910081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d223e1-86bd-4f49-8297-e4c37f1d9620 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:41.910557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d223e1-86bd-4f49-8297-e4c37f1d9620 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:41.910647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d223e1-86bd-4f49-8297-e4c37f1d9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:41.931543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f8d223e1-86bd-4f49-8297-e4c37f1d9620 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:41.932742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f8d223e1-86bd-4f49-8297-e4c37f1d9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:41.940844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:42.089664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e2e92-8881-41fb-a849-4cca109f7903 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:42.105212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e2e92-8881-41fb-a849-4cca109f7903 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:42.111681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7728c7-c236-45e0-9bf9-d03c10e8b3c7 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a15639a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:42.112316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7728c7-c236-45e0-9bf9-d03c10e8b3c7 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:42.112598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7728c7-c236-45e0-9bf9-d03c10e8b3c7 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:42.112872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7728c7-c236-45e0-9bf9-d03c10e8b3c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:42.121290 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7728c7-c236-45e0-9bf9-d03c10e8b3c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:42.123572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7728c7-c236-45e0-9bf9-d03c10e8b3c7 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:42.132999 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 717/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:43.023297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda892-306d-463c-8e3c-ab76d34517d1 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:43.023862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda892-306d-463c-8e3c-ab76d34517d1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:43.023862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bda892-306d-463c-8e3c-ab76d34517d1 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:43.025252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:43.031065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802fce-f45a-4101-a206-23861ac08539 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:43.031553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802fce-f45a-4101-a206-23861ac08539 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:43.031648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71802fce-f45a-4101-a206-23861ac08539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:43.050307 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-71802fce-f45a-4101-a206-23861ac08539 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:43.051515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-71802fce-f45a-4101-a206-23861ac08539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:43.059571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:43.221587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda892-306d-463c-8e3c-ab76d34517d1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:43.236684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bda892-306d-463c-8e3c-ab76d34517d1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:43.242140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648daf46-db6e-49c4-8aab-e95ea35098b9 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a14e4460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:43.242777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648daf46-db6e-49c4-8aab-e95ea35098b9 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:43.243049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648daf46-db6e-49c4-8aab-e95ea35098b9 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:43.243325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648daf46-db6e-49c4-8aab-e95ea35098b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:43.252025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648daf46-db6e-49c4-8aab-e95ea35098b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:43.253636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648daf46-db6e-49c4-8aab-e95ea35098b9 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:43.263484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 716/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:44.143768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c682eb-23bd-49ff-8700-510b0c72644c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:44.144311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c682eb-23bd-49ff-8700-510b0c72644c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:44.144311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c682eb-23bd-49ff-8700-510b0c72644c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:44.145736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:44.150850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454485-4a42-4777-b784-b7fdf2df789d None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:44.151280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454485-4a42-4777-b784-b7fdf2df789d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:44.151424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454485-4a42-4777-b784-b7fdf2df789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:44.170929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-64454485-4a42-4777-b784-b7fdf2df789d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:44.172173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-64454485-4a42-4777-b784-b7fdf2df789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:44.179998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:44.330851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c682eb-23bd-49ff-8700-510b0c72644c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:44.345490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c682eb-23bd-49ff-8700-510b0c72644c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:44.351622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d9cb-5721-4e1a-a012-4b2e66714161 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a1a18d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:44.352276 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d9cb-5721-4e1a-a012-4b2e66714161 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:44.352557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d9cb-5721-4e1a-a012-4b2e66714161 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:44.352833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d9cb-5721-4e1a-a012-4b2e66714161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:44.362110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d9cb-5721-4e1a-a012-4b2e66714161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:44.363732 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d9cb-5721-4e1a-a012-4b2e66714161 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:44.374627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 720/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:45.272630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0926-bced-428b-acb5-39536176ed62 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:45.273211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0926-bced-428b-acb5-39536176ed62 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:45.273211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c0926-bced-428b-acb5-39536176ed62 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:45.274460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:47:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:45.279507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeeae1-4adc-473a-8493-b1105444a21a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:45.279910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeeae1-4adc-473a-8493-b1105444a21a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:45.280055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaeeae1-4adc-473a-8493-b1105444a21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:45.298125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1aaeeae1-4adc-473a-8493-b1105444a21a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:45.299312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1aaeeae1-4adc-473a-8493-b1105444a21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:45.307031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:47:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:45.458401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c0926-bced-428b-acb5-39536176ed62 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:45.473031 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c0926-bced-428b-acb5-39536176ed62 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:45.478356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f09059-e9fa-44d8-9c76-1e48361e7946 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a1524850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:45.478982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09059-e9fa-44d8-9c76-1e48361e7946 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:45.479259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09059-e9fa-44d8-9c76-1e48361e7946 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:45.479530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09059-e9fa-44d8-9c76-1e48361e7946 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:45.487410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f09059-e9fa-44d8-9c76-1e48361e7946 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:45.488970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f09059-e9fa-44d8-9c76-1e48361e7946 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:45.498264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 719/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:47.612049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a909ec-43a6-4708-9b23-22e55d657582 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:47.612622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a909ec-43a6-4708-9b23-22e55d657582 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:47.612622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a909ec-43a6-4708-9b23-22e55d657582 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:47.614063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:47.619533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16ad81-6a60-494b-ba1e-13e06e49715e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:47.619980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16ad81-6a60-494b-ba1e-13e06e49715e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:47.620094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16ad81-6a60-494b-ba1e-13e06e49715e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:47.638025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0c16ad81-6a60-494b-ba1e-13e06e49715e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:47.639208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0c16ad81-6a60-494b-ba1e-13e06e49715e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:47.647295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:47:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:47.685575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a909ec-43a6-4708-9b23-22e55d657582 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:47.696178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a909ec-43a6-4708-9b23-22e55d657582 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:47.700823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c99a359-26f1-4148-a161-b8a5d7ed2c4e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1429eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:47.701510 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a359-26f1-4148-a161-b8a5d7ed2c4e service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:47.701821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a359-26f1-4148-a161-b8a5d7ed2c4e service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:47.702107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c99a359-26f1-4148-a161-b8a5d7ed2c4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:47.711682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a359-26f1-4148-a161-b8a5d7ed2c4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:47.713140 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c99a359-26f1-4148-a161-b8a5d7ed2c4e service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:47.723772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 723/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:50.108312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb631bcd-8a04-4f6d-94be-4aec726e3553 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:50.108844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb631bcd-8a04-4f6d-94be-4aec726e3553 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:50.109143 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb631bcd-8a04-4f6d-94be-4aec726e3553 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:50.110264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:50.115709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13482e89-da0e-4599-9022-0ff89ad3be2c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:50.116134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13482e89-da0e-4599-9022-0ff89ad3be2c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:50.116247 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13482e89-da0e-4599-9022-0ff89ad3be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:50.134766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-13482e89-da0e-4599-9022-0ff89ad3be2c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:50.135945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-13482e89-da0e-4599-9022-0ff89ad3be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:50.144490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:50.181199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb631bcd-8a04-4f6d-94be-4aec726e3553 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:50.192389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb631bcd-8a04-4f6d-94be-4aec726e3553 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:50.195793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c98d85-0ce7-4e3b-8f9b-a45a88fc40e4 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a160cb20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:50.196413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98d85-0ce7-4e3b-8f9b-a45a88fc40e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:50.196690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98d85-0ce7-4e3b-8f9b-a45a88fc40e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:50.196955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c98d85-0ce7-4e3b-8f9b-a45a88fc40e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:50.206559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c98d85-0ce7-4e3b-8f9b-a45a88fc40e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:50.207965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c98d85-0ce7-4e3b-8f9b-a45a88fc40e4 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:50.217416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 722/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:52.759873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d86ec3-3e5c-4f2c-9dc8-5f4da8d141f6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:52.760459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d86ec3-3e5c-4f2c-9dc8-5f4da8d141f6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:52.760459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d86ec3-3e5c-4f2c-9dc8-5f4da8d141f6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:52.762379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:47:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:52.767866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234019-0c21-44da-b039-fb0aadc9bf52 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:52.768299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234019-0c21-44da-b039-fb0aadc9bf52 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:52.768405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79234019-0c21-44da-b039-fb0aadc9bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:52.786376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-79234019-0c21-44da-b039-fb0aadc9bf52 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:52.787548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-79234019-0c21-44da-b039-fb0aadc9bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:52.795428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:52.834469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d86ec3-3e5c-4f2c-9dc8-5f4da8d141f6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:52.845763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d86ec3-3e5c-4f2c-9dc8-5f4da8d141f6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:52.849238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1085aaa-8666-4414-96c4-1d5c39029b29 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a14e2310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:52.849869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1085aaa-8666-4414-96c4-1d5c39029b29 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:52.850143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1085aaa-8666-4414-96c4-1d5c39029b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:52.850412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1085aaa-8666-4414-96c4-1d5c39029b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:52.859320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1085aaa-8666-4414-96c4-1d5c39029b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:52.860734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1085aaa-8666-4414-96c4-1d5c39029b29 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:52.869889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 726/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:47:55.301075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1456-5a01-4955-9e68-e0801dc01eb5 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:55.301611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1456-5a01-4955-9e68-e0801dc01eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:55.301611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e1456-5a01-4955-9e68-e0801dc01eb5 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:55.302972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:55.308926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3275f-ea87-4832-86c3-e850fa6ca0c3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:55.309496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3275f-ea87-4832-86c3-e850fa6ca0c3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:55.309607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3275f-ea87-4832-86c3-e850fa6ca0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:55.326954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-85e3275f-ea87-4832-86c3-e850fa6ca0c3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:55.328205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-85e3275f-ea87-4832-86c3-e850fa6ca0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:55.336117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:55.375114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1456-5a01-4955-9e68-e0801dc01eb5 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:55.386232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e1456-5a01-4955-9e68-e0801dc01eb5 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:55.390155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620364b0-a455-4ca0-b659-33097acb5b0d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1575070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:55.390820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620364b0-a455-4ca0-b659-33097acb5b0d service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:55.391100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620364b0-a455-4ca0-b659-33097acb5b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:55.391375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620364b0-a455-4ca0-b659-33097acb5b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:55.401435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620364b0-a455-4ca0-b659-33097acb5b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:55.403765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620364b0-a455-4ca0-b659-33097acb5b0d service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:55.414299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 725/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:47:57.730576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42919b0f-12a0-4126-96d4-d15d9fcf7f70 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:57.731152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42919b0f-12a0-4126-96d4-d15d9fcf7f70 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:57.731264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42919b0f-12a0-4126-96d4-d15d9fcf7f70 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:57.732581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:47:57.738264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188de4e-7f95-4771-8ed8-a7a4624f5da8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:57.738723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188de4e-7f95-4771-8ed8-a7a4624f5da8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:57.738832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188de4e-7f95-4771-8ed8-a7a4624f5da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:57.757345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6188de4e-7f95-4771-8ed8-a7a4624f5da8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:47:57.758545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6188de4e-7f95-4771-8ed8-a7a4624f5da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:47:57.767081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:47:57.804862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42919b0f-12a0-4126-96d4-d15d9fcf7f70 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:47:57.816399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42919b0f-12a0-4126-96d4-d15d9fcf7f70 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:47:57.820787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed37929-098b-4e19-9d20-ca319a8c7dae service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1505970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:47:57.821574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed37929-098b-4e19-9d20-ca319a8c7dae service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:47:57.821958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed37929-098b-4e19-9d20-ca319a8c7dae service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:47:57.822322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed37929-098b-4e19-9d20-ca319a8c7dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:47:57.833259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed37929-098b-4e19-9d20-ca319a8c7dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:47:57.834698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed37929-098b-4e19-9d20-ca319a8c7dae service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:47:57.844790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 729/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:47:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:00.172127 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49379a79-2767-40c7-978d-5781e494e048 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:00.172704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49379a79-2767-40c7-978d-5781e494e048 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:00.172704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49379a79-2767-40c7-978d-5781e494e048 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:00.174066 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:00.179882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c3089-6c49-453c-b970-8a440bad0412 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:00.180385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c3089-6c49-453c-b970-8a440bad0412 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:00.180505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c3089-6c49-453c-b970-8a440bad0412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:00.200908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c36c3089-6c49-453c-b970-8a440bad0412 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:00.202126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c36c3089-6c49-453c-b970-8a440bad0412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:00.209993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:48:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:00.249249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49379a79-2767-40c7-978d-5781e494e048 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:00.259752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49379a79-2767-40c7-978d-5781e494e048 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:00.263767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928faf4e-ece2-4c3a-9034-b266168ca3af service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a155a160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:00.264409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928faf4e-ece2-4c3a-9034-b266168ca3af service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:00.264684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928faf4e-ece2-4c3a-9034-b266168ca3af service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:00.264953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928faf4e-ece2-4c3a-9034-b266168ca3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:00.274524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928faf4e-ece2-4c3a-9034-b266168ca3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:00.275944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928faf4e-ece2-4c3a-9034-b266168ca3af service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:00.287479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 728/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:02.683435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2db4-e684-4bf7-b891-36aec0100d47 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:02.684096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2db4-e684-4bf7-b891-36aec0100d47 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:02.684518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f2db4-e684-4bf7-b891-36aec0100d47 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:02.687131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:48:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:02.692665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79484db-6d15-4f9e-a18c-73fe09b0e2a9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:02.693205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79484db-6d15-4f9e-a18c-73fe09b0e2a9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:02.693328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79484db-6d15-4f9e-a18c-73fe09b0e2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:02.711255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b79484db-6d15-4f9e-a18c-73fe09b0e2a9 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:02.712531 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b79484db-6d15-4f9e-a18c-73fe09b0e2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:02.722859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:48:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:02.773392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2db4-e684-4bf7-b891-36aec0100d47 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:02.785011 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f2db4-e684-4bf7-b891-36aec0100d47 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:02.789613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24dc757-2c5c-41d7-b9ee-7057dfb312dc service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1843070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:02.790281 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc757-2c5c-41d7-b9ee-7057dfb312dc service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:02.790565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc757-2c5c-41d7-b9ee-7057dfb312dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:02.790844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24dc757-2c5c-41d7-b9ee-7057dfb312dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:02.807930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dc757-2c5c-41d7-b9ee-7057dfb312dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:02.809502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24dc757-2c5c-41d7-b9ee-7057dfb312dc service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:02.823507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 732/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:05.192483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3980f-e0b0-4d84-bf88-43c6cdbe24b7 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:05.193114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3980f-e0b0-4d84-bf88-43c6cdbe24b7 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:05.193114 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3980f-e0b0-4d84-bf88-43c6cdbe24b7 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:05.194500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:05.200456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf3dc-6633-435e-acbc-2c6259437f5e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:05.200928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf3dc-6633-435e-acbc-2c6259437f5e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:05.201070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf3dc-6633-435e-acbc-2c6259437f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:05.220080 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3e9cf3dc-6633-435e-acbc-2c6259437f5e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:05.221313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3e9cf3dc-6633-435e-acbc-2c6259437f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:05.229147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:48:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:05.267596 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3980f-e0b0-4d84-bf88-43c6cdbe24b7 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:05.278858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3980f-e0b0-4d84-bf88-43c6cdbe24b7 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:05.282599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e5bf8-fabc-40ca-8d4b-dcc500f9960b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a14cb940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:05.283243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5bf8-fabc-40ca-8d4b-dcc500f9960b service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:05.283518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5bf8-fabc-40ca-8d4b-dcc500f9960b service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:05.283786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e5bf8-fabc-40ca-8d4b-dcc500f9960b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:05.293999 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e5bf8-fabc-40ca-8d4b-dcc500f9960b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:05.295449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e5bf8-fabc-40ca-8d4b-dcc500f9960b service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:05.305355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 731/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:07.626193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562756-3811-4356-bef9-91c48b7ceab6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:07.626193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562756-3811-4356-bef9-91c48b7ceab6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:07.626193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65562756-3811-4356-bef9-91c48b7ceab6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:07.627276 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:07.633065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad83d-182e-4b1a-8bd0-fde313164e45 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:07.633594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad83d-182e-4b1a-8bd0-fde313164e45 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:07.633594 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ad83d-182e-4b1a-8bd0-fde313164e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:07.654227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-550ad83d-182e-4b1a-8bd0-fde313164e45 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:07.655440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-550ad83d-182e-4b1a-8bd0-fde313164e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:07.663537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:48:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:07.701838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562756-3811-4356-bef9-91c48b7ceab6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:07.712962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65562756-3811-4356-bef9-91c48b7ceab6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:07.717262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4235fcc-bddc-40ca-bd3c-1300239998b5 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1541e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:07.718314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235fcc-bddc-40ca-bd3c-1300239998b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:07.718609 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235fcc-bddc-40ca-bd3c-1300239998b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:07.718924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4235fcc-bddc-40ca-bd3c-1300239998b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:07.734361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4235fcc-bddc-40ca-bd3c-1300239998b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:07.736903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4235fcc-bddc-40ca-bd3c-1300239998b5 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:07.748596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 735/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:10.038391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49cb6-b9bb-4c6f-9820-f4cc26eb4243 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:10.039006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49cb6-b9bb-4c6f-9820-f4cc26eb4243 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:10.039006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b49cb6-b9bb-4c6f-9820-f4cc26eb4243 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:10.040411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:10.045968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95591c65-881d-4916-83d1-ac084e452f68 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:10.046420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95591c65-881d-4916-83d1-ac084e452f68 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:10.046534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95591c65-881d-4916-83d1-ac084e452f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:10.064877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-95591c65-881d-4916-83d1-ac084e452f68 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:10.066085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-95591c65-881d-4916-83d1-ac084e452f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:10.074468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:10.109987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b49cb6-b9bb-4c6f-9820-f4cc26eb4243 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:10.127673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b49cb6-b9bb-4c6f-9820-f4cc26eb4243 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:10.134803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e368fec-9782-48a6-a753-589861386b6b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a11765b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:10.135467 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368fec-9782-48a6-a753-589861386b6b service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:10.135751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368fec-9782-48a6-a753-589861386b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:10.136101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e368fec-9782-48a6-a753-589861386b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:10.147065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e368fec-9782-48a6-a753-589861386b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:10.148513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e368fec-9782-48a6-a753-589861386b6b service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:10.159365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 734/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:44.194942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748d1e5-eacb-4739-a51e-83b28d2d1fed None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:44.195757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748d1e5-eacb-4739-a51e-83b28d2d1fed None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:44.195757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748d1e5-eacb-4739-a51e-83b28d2d1fed None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:44.196872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 737/1471] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:44.204246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067bdfa-e2e2-4f7e-bf6c-1dc98c5580d0 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:44.204921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067bdfa-e2e2-4f7e-bf6c-1dc98c5580d0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:44.205176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3067bdfa-e2e2-4f7e-bf6c-1dc98c5580d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:44.222863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3067bdfa-e2e2-4f7e-bf6c-1dc98c5580d0 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:44.224092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3067bdfa-e2e2-4f7e-bf6c-1dc98c5580d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:44.232210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 735/1472] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:44.283830 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102922ef-4d60-4694-88d7-0e645bb188b4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:44.284115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102922ef-4d60-4694-88d7-0e645bb188b4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:44.284399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102922ef-4d60-4694-88d7-0e645bb188b4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:44.285809 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 738/1473] 10.222.0.49 () {54 vars in 962 bytes} [Fri May 13 12:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:44.290781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a598b-200f-4b7b-9c29-a951cc4ef4d9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:44.291068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a598b-200f-4b7b-9c29-a951cc4ef4d9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:44.291451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76a598b-200f-4b7b-9c29-a951cc4ef4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:44.310839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c76a598b-200f-4b7b-9c29-a951cc4ef4d9 None None] MFA Rules not processed for user `296ed9d38ea741b1bc2c72fc398b5009`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:44.312163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c76a598b-200f-4b7b-9c29-a951cc4ef4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:44.319054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 736/1474] 10.222.0.49 () {58 vars in 1059 bytes} [Fri May 13 12:48:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:44.327209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102922ef-4d60-4694-88d7-0e645bb188b4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:44.337965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102922ef-4d60-4694-88d7-0e645bb188b4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:44.341992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e96d16-4744-4aa2-ac52-1a81063287b0 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=0xCk5xx_QBygXVCd79_-Lw, audit_chain_id=['0xCk5xx_QBygXVCd79_-Lw']) at 0x7fe8a15687c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296ed9d38ea741b1bc2c72fc398b5009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:44.342715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96d16-4744-4aa2-ac52-1a81063287b0 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:44.342995 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96d16-4744-4aa2-ac52-1a81063287b0 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:44.343332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e96d16-4744-4aa2-ac52-1a81063287b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:44.352954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e96d16-4744-4aa2-ac52-1a81063287b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:44.354727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e96d16-4744-4aa2-ac52-1a81063287b0 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:44.364415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 739/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:46.806656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0c0d5-d570-4e5d-992d-78f4cdeda87d None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:46.807401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0c0d5-d570-4e5d-992d-78f4cdeda87d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:46.807401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f0c0d5-d570-4e5d-992d-78f4cdeda87d None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:46.809190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 737/1476] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:48:46.815849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e484b4-7c54-4509-8d46-bbd1eb0ff11a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:46.816329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e484b4-7c54-4509-8d46-bbd1eb0ff11a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:46.816426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e484b4-7c54-4509-8d46-bbd1eb0ff11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:46.840620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e9e484b4-7c54-4509-8d46-bbd1eb0ff11a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:46.842003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e9e484b4-7c54-4509-8d46-bbd1eb0ff11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:46.850119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 740/1477] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:46.873998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0c0d5-d570-4e5d-992d-78f4cdeda87d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:46.887044 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f0c0d5-d570-4e5d-992d-78f4cdeda87d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:46.891510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=QTefMy6nSy-t-LNvfMIuuA, audit_chain_id=['QTefMy6nSy-t-LNvfMIuuA']) at 0x7fe8a11229d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:46.892163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:46.892442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:46.892853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:46.893871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:46.895647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:48:46.895647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:48:46.895647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:48:46.896781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f674f-c8c1-4dc9-b9a8-079b5c4dc006 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:46.917420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 738/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Fri May 13 12:48:46 2022] GET /identity/v3/projects => generated 2553 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:48:49.234375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafadf-adc0-40c3-a165-0a71acadef09 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:49.235123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafadf-adc0-40c3-a165-0a71acadef09 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:49.235123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cafadf-adc0-40c3-a165-0a71acadef09 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:49.236356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 741/1479] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:49.241971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1470c0-8ddc-4db8-8c14-6f590e3129c8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:49.242634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1470c0-8ddc-4db8-8c14-6f590e3129c8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:49.242634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1470c0-8ddc-4db8-8c14-6f590e3129c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:49.261866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-fc1470c0-8ddc-4db8-8c14-6f590e3129c8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:49.263095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-fc1470c0-8ddc-4db8-8c14-6f590e3129c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:49.271296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 739/1480] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:49.317172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafadf-adc0-40c3-a165-0a71acadef09 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:49.332525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cafadf-adc0-40c3-a165-0a71acadef09 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:49.338014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc5b48-141c-4462-adf6-7e9211a6659d service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a1841d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:49.339188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5b48-141c-4462-adf6-7e9211a6659d service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:49.339468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5b48-141c-4462-adf6-7e9211a6659d service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:49.339742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc5b48-141c-4462-adf6-7e9211a6659d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:49.348508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5b48-141c-4462-adf6-7e9211a6659d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:49.350118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc5b48-141c-4462-adf6-7e9211a6659d service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:49.359882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 742/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:51.828241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040aba-2c24-4661-8afe-927e371105e1 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:51.828829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040aba-2c24-4661-8afe-927e371105e1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:51.828829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040aba-2c24-4661-8afe-927e371105e1 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:51.830194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 740/1482] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:51.835794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f9b9d-658d-4273-be3e-afbffee623a4 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:51.836284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f9b9d-658d-4273-be3e-afbffee623a4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:51.836393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f9b9d-658d-4273-be3e-afbffee623a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:51.854279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-317f9b9d-658d-4273-be3e-afbffee623a4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:51.855490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-317f9b9d-658d-4273-be3e-afbffee623a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:51.863314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 743/1483] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:51.901754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040aba-2c24-4661-8afe-927e371105e1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:51.912414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040aba-2c24-4661-8afe-927e371105e1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:51.915871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17530331-3ce3-4dd4-9543-4d445b97d92f service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a118eca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:51.916526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17530331-3ce3-4dd4-9543-4d445b97d92f service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:51.916803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17530331-3ce3-4dd4-9543-4d445b97d92f service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:51.917101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17530331-3ce3-4dd4-9543-4d445b97d92f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:51.926568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17530331-3ce3-4dd4-9543-4d445b97d92f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:51.927994 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17530331-3ce3-4dd4-9543-4d445b97d92f service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:51.938577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 741/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:48:54.261670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c531a0f-260b-441b-901b-8a6da4a3629a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:54.262247 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c531a0f-260b-441b-901b-8a6da4a3629a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:54.262247 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c531a0f-260b-441b-901b-8a6da4a3629a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:54.263568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 744/1485] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:54.269609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa187f7-c7d5-4a45-85c8-cd94beb8bc1a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:54.270138 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa187f7-c7d5-4a45-85c8-cd94beb8bc1a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:54.270234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa187f7-c7d5-4a45-85c8-cd94beb8bc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:54.288890 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1fa187f7-c7d5-4a45-85c8-cd94beb8bc1a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:54.290143 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1fa187f7-c7d5-4a45-85c8-cd94beb8bc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:54.298013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 742/1486] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:54.338434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c531a0f-260b-441b-901b-8a6da4a3629a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:54.349303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c531a0f-260b-441b-901b-8a6da4a3629a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:54.352796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31343a45-e5e3-456b-9607-7aa45740c8da service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a17e6070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:54.353478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31343a45-e5e3-456b-9607-7aa45740c8da service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:54.354306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31343a45-e5e3-456b-9607-7aa45740c8da service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:54.354580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31343a45-e5e3-456b-9607-7aa45740c8da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:54.364391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31343a45-e5e3-456b-9607-7aa45740c8da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:54.365890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31343a45-e5e3-456b-9607-7aa45740c8da service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:54.377110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 745/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:56.825772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86163d20-0c35-4da3-9c09-96060dc2a0a0 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:56.826362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86163d20-0c35-4da3-9c09-96060dc2a0a0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:56.826362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86163d20-0c35-4da3-9c09-96060dc2a0a0 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:56.827669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 743/1488] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:56.833198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e3f66-fe7d-47cc-a2c2-3ac1c422c18a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:56.833713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e3f66-fe7d-47cc-a2c2-3ac1c422c18a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:56.833811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e3f66-fe7d-47cc-a2c2-3ac1c422c18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:56.852477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-573e3f66-fe7d-47cc-a2c2-3ac1c422c18a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:56.853723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-573e3f66-fe7d-47cc-a2c2-3ac1c422c18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:56.861669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 746/1489] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:56.902530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86163d20-0c35-4da3-9c09-96060dc2a0a0 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:56.915841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86163d20-0c35-4da3-9c09-96060dc2a0a0 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:56.920455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be65d4-622d-4584-af4a-77d195a8a542 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a10e1f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:56.921129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be65d4-622d-4584-af4a-77d195a8a542 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:56.921405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be65d4-622d-4584-af4a-77d195a8a542 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:56.921669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be65d4-622d-4584-af4a-77d195a8a542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:56.931382 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be65d4-622d-4584-af4a-77d195a8a542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:56.933342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be65d4-622d-4584-af4a-77d195a8a542 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:56.943688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 744/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:48:59.474254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44c15-7ee5-4cff-9a09-3e2e5d1055f0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:59.474860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44c15-7ee5-4cff-9a09-3e2e5d1055f0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:59.474860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f44c15-7ee5-4cff-9a09-3e2e5d1055f0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:59.476227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 747/1491] 10.222.0.49 () {54 vars in 926 bytes} [Fri May 13 12:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:48:59.482190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1f70-f37e-4154-bbac-8ea976d59763 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:59.482742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1f70-f37e-4154-bbac-8ea976d59763 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:59.482742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1f70-f37e-4154-bbac-8ea976d59763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:59.502057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-7ebd1f70-f37e-4154-bbac-8ea976d59763 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:48:59.503276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7ebd1f70-f37e-4154-bbac-8ea976d59763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:48:59.512517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 745/1492] 10.222.0.49 () {58 vars in 1023 bytes} [Fri May 13 12:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:48:59.552126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44c15-7ee5-4cff-9a09-3e2e5d1055f0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:48:59.564844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f44c15-7ee5-4cff-9a09-3e2e5d1055f0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:48:59.568452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfd5b0-6d0e-4953-9f8b-63973425ab07 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1790850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:48:59.569120 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd5b0-6d0e-4953-9f8b-63973425ab07 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:48:59.569403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd5b0-6d0e-4953-9f8b-63973425ab07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:48:59.569680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfd5b0-6d0e-4953-9f8b-63973425ab07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:48:59.580274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfd5b0-6d0e-4953-9f8b-63973425ab07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:48:59.581742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dfd5b0-6d0e-4953-9f8b-63973425ab07 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:48:59.592412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 748/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:50:29.940246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:29.940909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:29.940909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:29.959872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:50:29.961665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:29.970419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 746/1494] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:50:29.980506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:29.981085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:29.981085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:29.999049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:50:30.000258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:30.008671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 749/1495] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:50:30.013628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.026135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37ed31-8070-4751-baba-8b4990fbb65b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.031092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a11dad30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.031763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.032037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.032306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.033053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:50:30.033364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.034381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.034381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:50:30.034381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:50:30.035260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.048398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 747/1496] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:50:30.057291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.066906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260dc6b-2496-4b4e-ade9-9c7edd9b30ec None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.072326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a1461070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.073003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.073288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.073559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.074355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.076133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.076133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:50:30.076133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:50:30.077354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.115981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 750/1497] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:50:30 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:50:30.121027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.132852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057db7af-6989-40a9-9a89-923e2a2c4b43 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.189516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a1556eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.190197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.190549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.190749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.191449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.192473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.192473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:50:30.192473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:50:30.193691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.214683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 748/1498] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:50:30 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:50:30.218832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.230148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b874ae8-7f5e-47e4-afa3-62ec23591509 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.235217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a14c0190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.235976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.236421 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.236735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.237572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.238648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.238648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:50:30.238648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:50:30.239643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.254336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 751/1499] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:50:30.258938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.269105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1775a-9eb1-4efb-bed8-6019dff74a78 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.277798 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a15df8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.278501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.278783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.279058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.279795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.280814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.280814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:50:30.280814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:50:30.281732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae99d1-1c5f-477d-a039-50b056bc54cc admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.296460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 749/1500] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:50:30.300811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.312374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c0a2d-9f6d-4c6f-86b1-3deca4d3ec31 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.317101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a14e5cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.317989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.318271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.318548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] PATH_INFO: `/v3/projects/12d5ccfdf2a341be8df524d5b76a66c2/users/62310b1910d1436f9550f6e6455d7699/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.334239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12d5ccfdf2a341be8df524d5b76a66c2, user_id=62310b1910d1436f9550f6e6455d7699, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.335292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.335292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:50:30.335292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:50:30.338407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac18440-c004-41a9-a2b4-6aa5b1e8c5f3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.354572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 752/1501] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:50:30 2022] PUT /identity/v3/projects/12d5ccfdf2a341be8df524d5b76a66c2/users/62310b1910d1436f9550f6e6455d7699/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:50:30.365641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec457b0-9ef6-4d24-badb-46d374877a3b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.365928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec457b0-9ef6-4d24-badb-46d374877a3b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.366192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec457b0-9ef6-4d24-badb-46d374877a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.393340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-fec457b0-9ef6-4d24-badb-46d374877a3b None None] MFA Rules not processed for user `62310b1910d1436f9550f6e6455d7699`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:50:30.394599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-fec457b0-9ef6-4d24-badb-46d374877a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:30.462029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 750/1502] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:50:30.481084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3beb-faa8-423c-9733-c9f3787c3d66 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.481372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3beb-faa8-423c-9733-c9f3787c3d66 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.481650 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3beb-faa8-423c-9733-c9f3787c3d66 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.483026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 753/1503] 10.222.0.49 () {54 vars in 963 bytes} [Fri May 13 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:50:30.487898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c695a-f931-4c8c-a9d6-a05a0d3a1755 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.488188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c695a-f931-4c8c-a9d6-a05a0d3a1755 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.488463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c695a-f931-4c8c-a9d6-a05a0d3a1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.506407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-d65c695a-f931-4c8c-a9d6-a05a0d3a1755 None None] MFA Rules not processed for user `eada5adaf6724be28208b8c7b0110e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:50:30.507601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-d65c695a-f931-4c8c-a9d6-a05a0d3a1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:30.560463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 751/1504] 10.222.0.49 () {58 vars in 1060 bytes} [Fri May 13 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:50:30.567969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3beb-faa8-423c-9733-c9f3787c3d66 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.579279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3beb-faa8-423c-9733-c9f3787c3d66 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.582809 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1843070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.583446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.583728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.584000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.593698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.595141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.607857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 754/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:50:30.653495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3629cc-2d70-4e78-98bd-dd4b88d61587 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.653791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3629cc-2d70-4e78-98bd-dd4b88d61587 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.654115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3629cc-2d70-4e78-98bd-dd4b88d61587 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.655397 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 752/1506] 10.222.0.49 () {52 vars in 829 bytes} [Fri May 13 12:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:50:30.659259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.722144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169b0d2-1f1f-4d54-9fa6-f4c41e710c2a service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:30.727332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a14c60a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:30.728349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.728620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.728892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] PATH_INFO: `/v3/users/62310b1910d1436f9550f6e6455d7699` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.730191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62310b1910d1436f9550f6e6455d7699)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:30.731212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:30.731212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:50:30.731212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:50:30.732427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:30.804115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62310b1910d1436f9550f6e6455d7699'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:30.804756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62310b1910d1436f9550f6e6455d7699'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:30.805788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62310b1910d1436f9550f6e6455d7699'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:30.824288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62310b1910d1436f9550f6e6455d7699'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:30.833496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62310b1910d1436f9550f6e6455d7699'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:30.856315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 755/1507] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:50:30 2022] DELETE /identity/v3/users/62310b1910d1436f9550f6e6455d7699 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:50:30.860853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:30.861179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:30.861480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:30.880481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:50:30.881714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:30.941806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 753/1508] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:50:30.951920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:30.953453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:31.026891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905479e8-bf89-459d-ba9c-3f8cd1d7ac88 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:31.030409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c77b612-1092-4d47-9321-e58deb94bf29 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1505970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:31.031063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b612-1092-4d47-9321-e58deb94bf29 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:31.031341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b612-1092-4d47-9321-e58deb94bf29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:31.031610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c77b612-1092-4d47-9321-e58deb94bf29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:31.042315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77b612-1092-4d47-9321-e58deb94bf29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:31.043774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c77b612-1092-4d47-9321-e58deb94bf29 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:31.054215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 756/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:50:31.401221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:50:31.402798 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:50:31.418982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b73780-3b5b-4760-a011-6c17f4bbf845 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:50:31.429306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=FXcoErqaSmyOaAALD7EblA, audit_chain_id=['FXcoErqaSmyOaAALD7EblA']) at 0x7fe8a10e1400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:50:31.430727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:50:31.431001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:50:31.431271 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] PATH_INFO: `/v3/projects/12d5ccfdf2a341be8df524d5b76a66c2` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:50:31.432684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12d5ccfdf2a341be8df524d5b76a66c2)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:50:31.433622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:50:31.433622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:50:31.433622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:50:31.434848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:50:31.502306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12d5ccfdf2a341be8df524d5b76a66c2', 'request_id': 'req-9339a125-7219-46c0-adcd-396c112855d7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:31.514775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12d5ccfdf2a341be8df524d5b76a66c2', 'request_id': 'req-9339a125-7219-46c0-adcd-396c112855d7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:31.526561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12d5ccfdf2a341be8df524d5b76a66c2', 'request_id': 'req-9339a125-7219-46c0-adcd-396c112855d7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:31.560894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] The token cache is being invalidate because project 12d5ccfdf2a341be8df524d5b76a66c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:50:31.561199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:31.564859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9339a125-7219-46c0-adcd-396c112855d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:50:31.568051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 754/1510] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:50:31 2022] DELETE /identity/v3/projects/12d5ccfdf2a341be8df524d5b76a66c2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:52:14.973159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b064f2-2223-46db-9e30-ee85174690a0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:14.973583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b064f2-2223-46db-9e30-ee85174690a0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:14.973583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b064f2-2223-46db-9e30-ee85174690a0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:14.974910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:14.980498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda3a7-96f2-4f94-8c35-53a0d2d2e7cd None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:14.981032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda3a7-96f2-4f94-8c35-53a0d2d2e7cd None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:14.981156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacda3a7-96f2-4f94-8c35-53a0d2d2e7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:14.999545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-bacda3a7-96f2-4f94-8c35-53a0d2d2e7cd None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:15.000777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-bacda3a7-96f2-4f94-8c35-53a0d2d2e7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:15.061576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:15.232505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b064f2-2223-46db-9e30-ee85174690a0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:15.234253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-70b064f2-2223-46db-9e30-ee85174690a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:15.309956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b064f2-2223-46db-9e30-ee85174690a0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:15.315317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814f021-2cbf-4358-ba37-ed2b7cb62c0c service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a14d3400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:15.315969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814f021-2cbf-4358-ba37-ed2b7cb62c0c service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:15.316249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814f021-2cbf-4358-ba37-ed2b7cb62c0c service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:15.316520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814f021-2cbf-4358-ba37-ed2b7cb62c0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:15.325802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814f021-2cbf-4358-ba37-ed2b7cb62c0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:15.327311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f814f021-2cbf-4358-ba37-ed2b7cb62c0c service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:15.337149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 758/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:16.072553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b69ed-c65b-4929-95f8-7935389c83e3 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:16.073155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b69ed-c65b-4929-95f8-7935389c83e3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:16.073392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b69ed-c65b-4929-95f8-7935389c83e3 None None] PATH_INFO: `/v3` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:16.074799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 756/1514] 10.222.0.52 () {54 vars in 925 bytes} [Fri May 13 12:52:16 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:52:16.081527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0886f2-c7ef-4595-98fb-ee42e16c1aa9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:16.082024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0886f2-c7ef-4595-98fb-ee42e16c1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:16.082142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0886f2-c7ef-4595-98fb-ee42e16c1aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:16.101188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-dc0886f2-c7ef-4595-98fb-ee42e16c1aa9 None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:16.102412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-dc0886f2-c7ef-4595-98fb-ee42e16c1aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:16.176880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 759/1515] 10.222.0.52 () {58 vars in 1015 bytes} [Fri May 13 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:16.277339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69682-67c2-4147-88e2-c3fbdab6b39c None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:16.277642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69682-67c2-4147-88e2-c3fbdab6b39c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:16.277828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c69682-67c2-4147-88e2-c3fbdab6b39c None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:16.279151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 757/1516] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:16.284326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eea64-34b8-4a28-8656-f119e07b2c3f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:16.284610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eea64-34b8-4a28-8656-f119e07b2c3f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:16.284885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825eea64-34b8-4a28-8656-f119e07b2c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:16.305485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-825eea64-34b8-4a28-8656-f119e07b2c3f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:16.306750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-825eea64-34b8-4a28-8656-f119e07b2c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:16.314806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 760/1517] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:16.474548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c69682-67c2-4147-88e2-c3fbdab6b39c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:16.489429 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c69682-67c2-4147-88e2-c3fbdab6b39c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:16.495042 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d330a3-9e1d-4469-950a-f95c0a34bcf7 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a15243a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:16.495677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d330a3-9e1d-4469-950a-f95c0a34bcf7 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:16.495957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d330a3-9e1d-4469-950a-f95c0a34bcf7 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:16.496230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d330a3-9e1d-4469-950a-f95c0a34bcf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:16.504740 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d330a3-9e1d-4469-950a-f95c0a34bcf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:16.506402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d330a3-9e1d-4469-950a-f95c0a34bcf7 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:16.516948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 758/1518] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:25.376217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315b56-870e-4a77-b558-8d224abcf222 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:25.376879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315b56-870e-4a77-b558-8d224abcf222 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:25.377203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54315b56-870e-4a77-b558-8d224abcf222 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:25.378939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 761/1519] 10.222.0.49 () {54 vars in 960 bytes} [Fri May 13 12:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:25.385796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235eab-2689-44a1-8b44-dd5f8ed0f14b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:25.386341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235eab-2689-44a1-8b44-dd5f8ed0f14b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:25.386341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c235eab-2689-44a1-8b44-dd5f8ed0f14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:25.404671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-8c235eab-2689-44a1-8b44-dd5f8ed0f14b None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:25.405894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8c235eab-2689-44a1-8b44-dd5f8ed0f14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:25.414451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 759/1520] 10.222.0.49 () {58 vars in 1057 bytes} [Fri May 13 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:25.424246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54315b56-870e-4a77-b558-8d224abcf222 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:25.439291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54315b56-870e-4a77-b558-8d224abcf222 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:25.445211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34100556-e859-4007-9c72-9170b5d100a1 service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=nMkL1F6lT7Gvks3pg8aVCg, audit_chain_id=['nMkL1F6lT7Gvks3pg8aVCg']) at 0x7fe8a1579880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00056de203d84284a032f715ef2d6a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:25.445849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34100556-e859-4007-9c72-9170b5d100a1 service placement] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:25.446127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34100556-e859-4007-9c72-9170b5d100a1 service placement] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:25.446399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34100556-e859-4007-9c72-9170b5d100a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:25.455204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34100556-e859-4007-9c72-9170b5d100a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:25.456802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34100556-e859-4007-9c72-9170b5d100a1 service placement] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:25.466936 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 762/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:27.862407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703fa14-ffd4-4e36-85b8-c7c56c8a0da4 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:27.862964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703fa14-ffd4-4e36-85b8-c7c56c8a0da4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:27.863080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703fa14-ffd4-4e36-85b8-c7c56c8a0da4 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:27.864443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:27.870787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4e6b-9b34-42eb-8246-56f317631122 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:27.871302 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4e6b-9b34-42eb-8246-56f317631122 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:27.871418 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f4e6b-9b34-42eb-8246-56f317631122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:27.890313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a40f4e6b-9b34-42eb-8246-56f317631122 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:27.891560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a40f4e6b-9b34-42eb-8246-56f317631122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:27.899828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:28.053459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703fa14-ffd4-4e36-85b8-c7c56c8a0da4 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:28.069533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703fa14-ffd4-4e36-85b8-c7c56c8a0da4 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:28.075923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb24442-4fa9-44ca-be5c-9fdb1f67446d service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a1176370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:28.076578 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24442-4fa9-44ca-be5c-9fdb1f67446d service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:28.076862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24442-4fa9-44ca-be5c-9fdb1f67446d service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:28.077173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb24442-4fa9-44ca-be5c-9fdb1f67446d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:28.086160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb24442-4fa9-44ca-be5c-9fdb1f67446d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:28.089133 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb24442-4fa9-44ca-be5c-9fdb1f67446d service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:28.099731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 761/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:29.029615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5786b-7feb-462d-a307-f0c6f87bb3ef None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:29.030285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5786b-7feb-462d-a307-f0c6f87bb3ef None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:29.030285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5786b-7feb-462d-a307-f0c6f87bb3ef None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:29.031568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri May 13 12:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:29.036664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87b931-239c-4553-8fa1-0a5b6367c7fb None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:29.037288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87b931-239c-4553-8fa1-0a5b6367c7fb None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:29.037288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87b931-239c-4553-8fa1-0a5b6367c7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:29.055433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-8a87b931-239c-4553-8fa1-0a5b6367c7fb None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:29.057252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8a87b931-239c-4553-8fa1-0a5b6367c7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:29.068147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri May 13 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:29.222241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5786b-7feb-462d-a307-f0c6f87bb3ef None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:29.237360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5786b-7feb-462d-a307-f0c6f87bb3ef None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:29.242800 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24301e86-4f78-4e72-b0c3-ff27cf534431 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=aCU9wkzsTnWlN5Mn8ApG-Q, audit_chain_id=['aCU9wkzsTnWlN5Mn8ApG-Q']) at 0x7fe8a31910a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:29.243491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301e86-4f78-4e72-b0c3-ff27cf534431 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:29.244563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301e86-4f78-4e72-b0c3-ff27cf534431 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:29.244884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24301e86-4f78-4e72-b0c3-ff27cf534431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:29.254150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24301e86-4f78-4e72-b0c3-ff27cf534431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:29.255769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24301e86-4f78-4e72-b0c3-ff27cf534431 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:29.266115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 765/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:33.618117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e8359-4346-41ba-acb1-7bec196c1a97 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:33.618759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e8359-4346-41ba-acb1-7bec196c1a97 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:33.618871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140e8359-4346-41ba-acb1-7bec196c1a97 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:33.620166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:33.625642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66b1c7-3d07-4334-9b23-5dde06a1b488 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:33.626180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66b1c7-3d07-4334-9b23-5dde06a1b488 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:33.626180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66b1c7-3d07-4334-9b23-5dde06a1b488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:33.647845 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2b66b1c7-3d07-4334-9b23-5dde06a1b488 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:33.649094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2b66b1c7-3d07-4334-9b23-5dde06a1b488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:33.657560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:33.694255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e8359-4346-41ba-acb1-7bec196c1a97 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:33.696035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-140e8359-4346-41ba-acb1-7bec196c1a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:33.754853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140e8359-4346-41ba-acb1-7bec196c1a97 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:33.758477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d9143-7384-44ce-90ec-0df304f74529 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1176670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:33.759741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d9143-7384-44ce-90ec-0df304f74529 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:33.760195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d9143-7384-44ce-90ec-0df304f74529 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:33.760477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d9143-7384-44ce-90ec-0df304f74529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:33.769557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d9143-7384-44ce-90ec-0df304f74529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:33.770985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d9143-7384-44ce-90ec-0df304f74529 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:33.781418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 764/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:36.097769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529388a-e3f2-4718-bf05-cc49428071f8 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:36.098343 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529388a-e3f2-4718-bf05-cc49428071f8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:36.098343 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529388a-e3f2-4718-bf05-cc49428071f8 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:36.099684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:36.105153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b82ce-f397-4316-bcc5-3a4e2a6f713f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:36.105613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b82ce-f397-4316-bcc5-3a4e2a6f713f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:36.105718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b82ce-f397-4316-bcc5-3a4e2a6f713f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:36.123863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-580b82ce-f397-4316-bcc5-3a4e2a6f713f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:36.126914 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-580b82ce-f397-4316-bcc5-3a4e2a6f713f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:36.132860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:36.170105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529388a-e3f2-4718-bf05-cc49428071f8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:36.180907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529388a-e3f2-4718-bf05-cc49428071f8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:36.185990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d1611-4548-43eb-8e71-27270a89e51d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1843250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:36.185990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d1611-4548-43eb-8e71-27270a89e51d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:36.185990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d1611-4548-43eb-8e71-27270a89e51d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:36.185990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d1611-4548-43eb-8e71-27270a89e51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:36.194999 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d1611-4548-43eb-8e71-27270a89e51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:36.196437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d1611-4548-43eb-8e71-27270a89e51d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:36.207110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 768/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:52:40.164928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5c11-4f10-4905-b7d0-6204c4a2e456 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:40.166183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5c11-4f10-4905-b7d0-6204c4a2e456 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:40.166183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d5c11-4f10-4905-b7d0-6204c4a2e456 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:40.167538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:52:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:52:40.173301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110dc3d-bbff-4dd9-9284-da290bdffc5e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:40.173817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110dc3d-bbff-4dd9-9284-da290bdffc5e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:40.173922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110dc3d-bbff-4dd9-9284-da290bdffc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:40.192261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3110dc3d-bbff-4dd9-9284-da290bdffc5e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:40.193511 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3110dc3d-bbff-4dd9-9284-da290bdffc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:40.202156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:40.492314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5c11-4f10-4905-b7d0-6204c4a2e456 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:40.495057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c75d5c11-4f10-4905-b7d0-6204c4a2e456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:40.564602 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d5c11-4f10-4905-b7d0-6204c4a2e456 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:40.568111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760646c0-a217-45cc-8f36-5e784c5ec150 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a14cb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:40.568754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760646c0-a217-45cc-8f36-5e784c5ec150 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:40.569063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760646c0-a217-45cc-8f36-5e784c5ec150 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:40.569337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760646c0-a217-45cc-8f36-5e784c5ec150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:40.580634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760646c0-a217-45cc-8f36-5e784c5ec150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:40.582115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760646c0-a217-45cc-8f36-5e784c5ec150 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:40.593207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 767/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:52:42.943060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7ac7-7440-4b3a-b4d4-6108264ba654 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:42.943628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7ac7-7440-4b3a-b4d4-6108264ba654 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:42.943628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7ac7-7440-4b3a-b4d4-6108264ba654 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:42.944998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri May 13 12:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:52:42.951837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e590a7-183d-452c-a38a-09ff7c313c26 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:42.952453 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e590a7-183d-452c-a38a-09ff7c313c26 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:42.952710 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e590a7-183d-452c-a38a-09ff7c313c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:42.974409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-a8e590a7-183d-452c-a38a-09ff7c313c26 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:52:42.975634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a8e590a7-183d-452c-a38a-09ff7c313c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:42.987301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri May 13 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:52:43.271269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7ac7-7440-4b3a-b4d4-6108264ba654 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:52:43.273251 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-279f7ac7-7440-4b3a-b4d4-6108264ba654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:52:43.287272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7ac7-7440-4b3a-b4d4-6108264ba654 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:52:43.291584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a26ef6-a8a7-44d5-8bf3-bd26b967b36d service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1505940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:52:43.292261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26ef6-a8a7-44d5-8bf3-bd26b967b36d service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:52:43.292539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26ef6-a8a7-44d5-8bf3-bd26b967b36d service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:52:43.292809 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a26ef6-a8a7-44d5-8bf3-bd26b967b36d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:52:43.302434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26ef6-a8a7-44d5-8bf3-bd26b967b36d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:52:43.303856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a26ef6-a8a7-44d5-8bf3-bd26b967b36d service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:52:43.313640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 771/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:16.746151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:16.747168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:16.747819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:16.776815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:16.778801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:16.792093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 769/1540] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:16.802655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:16.803693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:16.804187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:16.830158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:16.831913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:16.847623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 772/1541] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:16.852470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:16.872156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f7547-c15b-44b0-ba48-5dbc67353240 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:16.879723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a11ca280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:16.880410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:16.880694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:16.880966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:16.881869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:16.882180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:16.883869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:16.904024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 770/1542] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:16.923863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:16.941754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab296e-a8c6-4ee1-8691-1f8b69e19950 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:16.949756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c1ddb-1b23-4d84-9cf7-47e17e91a895 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a14574f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:16.950908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1ddb-1b23-4d84-9cf7-47e17e91a895 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:16.951437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1ddb-1b23-4d84-9cf7-47e17e91a895 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:16.951963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c1ddb-1b23-4d84-9cf7-47e17e91a895 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:16.952972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c1ddb-1b23-4d84-9cf7-47e17e91a895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:16.955710 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679c1ddb-1b23-4d84-9cf7-47e17e91a895 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.011934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 773/1543] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:16 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:17.015987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.035792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d15fbb-7a3e-4d9b-bfaa-8bfd20708e6f admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.118850 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1556bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.119690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.119976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.120246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.125274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.127855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.156942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 771/1544] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/users => generated 283 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:17.161258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.162000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e7d7-453f-49c0-bbfc-46e5c6256977 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.163375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e7d7-453f-49c0-bbfc-46e5c6256977 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.163766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33e7d7-453f-49c0-bbfc-46e5c6256977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.173716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22f111-a2d5-4b6b-aecc-2921ad7841f5 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.185632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1143a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.186321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.186601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.186876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.187738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.191473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.201464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ea33e7d7-453f-49c0-bbfc-46e5c6256977 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.202603 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ea33e7d7-453f-49c0-bbfc-46e5c6256977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.213313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 772/1545] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:17.221485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.227865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 774/1546] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.239405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.239749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.239965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.244438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf0e15c-f83d-4e51-81a2-ec85c82df9b4 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.265729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb1a7e-2fc5-4b9f-a6b7-3f0ac041fc73 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1139490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.266475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb1a7e-2fc5-4b9f-a6b7-3f0ac041fc73 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.266792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb1a7e-2fc5-4b9f-a6b7-3f0ac041fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.267018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb1a7e-2fc5-4b9f-a6b7-3f0ac041fc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.267937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb1a7e-2fc5-4b9f-a6b7-3f0ac041fc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.274790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fb1a7e-2fc5-4b9f-a6b7-3f0ac041fc73 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.282903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.288413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.300459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 773/1547] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:17.301633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deddbcf-e704-41d9-87fb-4a20926ad875 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.303294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deddbcf-e704-41d9-87fb-4a20926ad875 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.303614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deddbcf-e704-41d9-87fb-4a20926ad875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.305842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 775/1548] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:17.312007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.327611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e87c8d8-c938-4bcd-b547-af122e849fc7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.357599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a15329d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.358519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.358796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.359071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] PATH_INFO: `/v3/projects/6dd8a886a6ac4878b0dd960ce0a448a7/users/5f05322a0a024599bccf855997b0b2f0/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.393728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd8a886a6ac4878b0dd960ce0a448a7, user_id=5f05322a0a024599bccf855997b0b2f0, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.396871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.430027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 776/1549] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:17 2022] PUT /identity/v3/projects/6dd8a886a6ac4878b0dd960ce0a448a7/users/5f05322a0a024599bccf855997b0b2f0/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:17.430027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.513459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9dc601-b2da-46c2-aa1f-2c49256bb84e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.519551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mNoMSYcdQbKQgPRBRu3w9g, audit_chain_id=['mNoMSYcdQbKQgPRBRu3w9g']) at 0x7fe8a14d37f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.520721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.521277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.522147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.523510 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:17.524517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.525898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 12:54:17.525898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:54:17.525898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:54:17.527372 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe1afa-f21d-4c37-a537-fcc52cc303c5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.544413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 777/1550] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:17.546394 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e84c4-6536-4d9d-a765-4dc87a31d6c8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.553068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e84c4-6536-4d9d-a765-4dc87a31d6c8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.554108 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e84c4-6536-4d9d-a765-4dc87a31d6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.561816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0deddbcf-e704-41d9-87fb-4a20926ad875 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.567932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0deddbcf-e704-41d9-87fb-4a20926ad875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.582534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 774/1551] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.589008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b9de3-7573-45fb-9534-cb8cc6a6917a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.589008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b9de3-7573-45fb-9534-cb8cc6a6917a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.589008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5b9de3-7573-45fb-9534-cb8cc6a6917a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.602771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-816e84c4-6536-4d9d-a765-4dc87a31d6c8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.604092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-816e84c4-6536-4d9d-a765-4dc87a31d6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.607839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9e5b9de3-7573-45fb-9534-cb8cc6a6917a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.609334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9e5b9de3-7573-45fb-9534-cb8cc6a6917a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.620417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 778/1552] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.620417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9981c-c8e1-4a6a-a702-3c181ba2cb5d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.620417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9981c-c8e1-4a6a-a702-3c181ba2cb5d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.620417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9981c-c8e1-4a6a-a702-3c181ba2cb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.628782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 775/1553] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.630602 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.631192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.631482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.652282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.653788 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.658795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-82e9981c-c8e1-4a6a-a702-3c181ba2cb5d None None] MFA Rules not processed for user `5f05322a0a024599bccf855997b0b2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.660238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-82e9981c-c8e1-4a6a-a702-3c181ba2cb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.662838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 776/1554] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.663621 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.680489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3434c3-4a8d-432e-a85e-fc7205489295 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.686369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mNoMSYcdQbKQgPRBRu3w9g, audit_chain_id=['mNoMSYcdQbKQgPRBRu3w9g']) at 0x7fe8a1019610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.687023 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.687301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.687571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.688257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.689300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:54:17.689300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:54:17.689300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:54:17.690465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983c9fc-0b23-4706-8a68-5e5fe8acaaed admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.717387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 777/1555] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:17.719028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a5a9-ad40-47cb-87c1-a4bd54cf3ed3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.719309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a5a9-ad40-47cb-87c1-a4bd54cf3ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.719587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc6a5a9-ad40-47cb-87c1-a4bd54cf3ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.727989 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 779/1556] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.734265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de8aef-cc50-48b4-a5ba-ce24a6fd814a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.734561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de8aef-cc50-48b4-a5ba-ce24a6fd814a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.734865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de8aef-cc50-48b4-a5ba-ce24a6fd814a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.739038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1cc6a5a9-ad40-47cb-87c1-a4bd54cf3ed3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.740246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1cc6a5a9-ad40-47cb-87c1-a4bd54cf3ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.754222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-22de8aef-cc50-48b4-a5ba-ce24a6fd814a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.755472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-22de8aef-cc50-48b4-a5ba-ce24a6fd814a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.802996 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 778/1557] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.805476 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf52f6-23c4-4fef-87d9-d9636cd79971 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.805922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf52f6-23c4-4fef-87d9-d9636cd79971 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.806377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf52f6-23c4-4fef-87d9-d9636cd79971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.822106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 780/1558] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.823441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd456ea-fa10-4a3a-9cd1-bd916ba77e1b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.823734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd456ea-fa10-4a3a-9cd1-bd916ba77e1b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.824050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd456ea-fa10-4a3a-9cd1-bd916ba77e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.831403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5acf52f6-23c4-4fef-87d9-d9636cd79971 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.832626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5acf52f6-23c4-4fef-87d9-d9636cd79971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.844444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-dcd456ea-fa10-4a3a-9cd1-bd916ba77e1b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.845623 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 779/1559] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.846262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-dcd456ea-fa10-4a3a-9cd1-bd916ba77e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.850538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.850716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.850977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.865230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 781/1560] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.865230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.865230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.865230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.877485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.878712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.886106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:17.887354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:17.887939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 780/1561] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.897130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.903019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 782/1562] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:17.904076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.909612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e91099-1ece-4cd3-a822-571728fee644 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.913530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6a78b-6dc8-429c-b41f-378fc72d5673 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.914344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mNoMSYcdQbKQgPRBRu3w9g, audit_chain_id=['mNoMSYcdQbKQgPRBRu3w9g']) at 0x7fe8a1028280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.915123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.915403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.915671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.916390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.919045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1838370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.919215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.919811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.920092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.920363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.921092 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.922948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.939392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 781/1563] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/users => generated 294 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:17.940278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.951148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41336219-5e19-4ef4-9368-531041892f3d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:17.954467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 783/1564] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:17 2022] POST /identity/v3/projects => generated 359 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:17.955283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.958730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a10eb460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:17.959396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:17.959674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:17.959944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:17.960667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:17.960971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:17.962625 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:17.976765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 782/1565] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:17.977676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:17.988208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901f338e-eeca-489e-8847-4bd06dbff499 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.025631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9991d-8197-407c-b993-5619d81c3d3a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.030970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mfmxtX7MQ0G4SkC6827Eyg, audit_chain_id=['mfmxtX7MQ0G4SkC6827Eyg']) at 0x7fe8a14dcc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.031643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.031924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.032201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.032933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:18.033280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.034888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f557d-aea9-4bd2-98e9-d8adc33a493f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.046284 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a10a21f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.046951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.047079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 784/1566] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:18.047219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.047489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.048221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:18.048338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.048518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.048614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.048800 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.050170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb405a-3b23-4701-863b-f86c80d097d2 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.063774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 783/1567] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:18.065277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.065561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.065830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.070977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:18.072176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:18.080330 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 785/1568] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:18.081799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.084910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:18.086140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:18.092007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa905-bc50-4ef7-a991-e1a832f2ca60 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.094734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 784/1569] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:18.095524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.096432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a1579880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.097116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.097397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.097669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.098395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:18.098695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.100540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.106309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485073b-76ec-424d-b0f4-df91b5996449 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.111953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mNoMSYcdQbKQgPRBRu3w9g, audit_chain_id=['mNoMSYcdQbKQgPRBRu3w9g']) at 0x7fe8a1032ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.112736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.113059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.113345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.113643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 786/1570] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:18.114091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.114451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.116222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.123965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c95ce-a39d-4a83-8e20-f62054c114f4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.130277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 785/1571] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:18.130277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.130556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1838370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.130556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.130556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.130556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.131019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.132134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:54:18.132134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:54:18.132134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:54:18.133364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.138970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405077b-591e-489b-8368-db10948bd09f admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.143644 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a118efd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.144330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.144689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.144963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.145927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.148334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.158144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 787/1572] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.158144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.168438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5aa98-ca1c-4da8-bc23-13fed2b00788 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.173739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mfmxtX7MQ0G4SkC6827Eyg, audit_chain_id=['mfmxtX7MQ0G4SkC6827Eyg']) at 0x7fe8a10abf40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.174409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.174692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.174964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.175652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.177170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 786/1573] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.177984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.180823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.207765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 788/1574] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/projects => generated 391 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.211230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.244954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c65436-7528-4f09-9060-489a57aa5108 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.271848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dabe93-885c-4036-9d37-8ede7e335ed3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.278788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a13e8760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.279460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.279745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.280017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.280743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:18.281082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.282698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.301787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 789/1575] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:18.301787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.306597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a1176220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.307297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.307582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.307860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.308592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.310558 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.312404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1246ef7f-05e5-4738-83a7-43d0a2e72501 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.317489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=akw78cWOSVuF9l5PvCTRcA, audit_chain_id=['akw78cWOSVuF9l5PvCTRcA']) at 0x7fe8a109cb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.318060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.318333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.318636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.319351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:18.319648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.321257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.336436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 790/1576] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:18.338268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.350781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 787/1577] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/projects => generated 371 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.350781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.352529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136d928-88b7-4b67-bf36-9be7f0465d1f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.411733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a1b73610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.412227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7625ed-fa07-4e40-8d77-974a7d5dbc20 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.412370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.412752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.412906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.413853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.415504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.416965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mNoMSYcdQbKQgPRBRu3w9g, audit_chain_id=['mNoMSYcdQbKQgPRBRu3w9g']) at 0x7fe8a118e310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.417735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.418019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.418291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.419029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.420637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.437236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 788/1578] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:18.437236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.448137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 791/1579] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.448137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.448437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798ac48-8b56-44b1-ac2d-cbc381cfa214 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.504016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a10e5ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.504690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.504972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.505264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.505990 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.507587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.512826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ee3f3-68a8-42f0-b03b-20f9104b1765 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.517542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a13dbe20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.518249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.518540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.518649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 789/1580] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:18.518817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.519584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.521582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.522082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.534002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d88e87-d74b-4bf4-9807-7f3880e670aa admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.538724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mfmxtX7MQ0G4SkC6827Eyg, audit_chain_id=['mfmxtX7MQ0G4SkC6827Eyg']) at 0x7fe8a109a190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.539448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.539729 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.540002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.540698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.542725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.544819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 792/1581] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.548741 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.560238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3146ba80-2214-4eeb-8777-9cc8e92f14af admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.564154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 790/1582] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.565093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a109c580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.565245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.565746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.566024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.566296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.567284 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.569039 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.575656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f2ad4-e219-4064-992d-ce2162593ccd admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.581700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=akw78cWOSVuF9l5PvCTRcA, audit_chain_id=['akw78cWOSVuF9l5PvCTRcA']) at 0x7fe8a117fe50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.582514 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.582803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.583080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.583777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.585805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.601258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 793/1583] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/projects => generated 401 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.601258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.619921 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 791/1584] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.621313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.664242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58714d5-fd4c-4646-8b5a-5497ca15dd88 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.681799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d94b6-2455-4ab9-bbf9-0816402e538a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.687096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mNoMSYcdQbKQgPRBRu3w9g, audit_chain_id=['mNoMSYcdQbKQgPRBRu3w9g']) at 0x7fe8a1129400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.687981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.688263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.688536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] PATH_INFO: `/v3/projects/0b148a16abbc49ed816ed45fc1ad4980/users/e9eb9ff59bef4adb83fbb4c5b358280a/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.704855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b148a16abbc49ed816ed45fc1ad4980, user_id=e9eb9ff59bef4adb83fbb4c5b358280a, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.705961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:54:18.705961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:54:18.705961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:54:18.707936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.722574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a1843070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.722984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 792/1585] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:18 2022] PUT /identity/v3/projects/0b148a16abbc49ed816ed45fc1ad4980/users/e9eb9ff59bef4adb83fbb4c5b358280a/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:18.723253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.723535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.723811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.724036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.724501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.726602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.750505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 794/1586] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.750505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.757796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cff5e-94e0-4d7d-a159-3617a1c735d9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.786763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d766ddd-7a5f-4b29-a21a-71cd75a5e6be admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.791403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a1129a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.792067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.792389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.792653 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.793871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.795804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.814696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1554cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.815665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.815950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.816223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] PATH_INFO: `/v3/projects/b91973a432b846db8bb07d1f668b88bf/users/411f13f8ba4b48dd972756373d9a8424/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.817081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 793/1587] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.821338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.831693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60e317-e894-48f2-a0b5-a693a32e65d8 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.831890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91973a432b846db8bb07d1f668b88bf, user_id=411f13f8ba4b48dd972756373d9a8424, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.834608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.836322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a11221c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.837004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.837281 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.837549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.838317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.840043 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.847908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 795/1588] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:18 2022] PUT /identity/v3/projects/b91973a432b846db8bb07d1f668b88bf/users/411f13f8ba4b48dd972756373d9a8424/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:18.851076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.856523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 794/1589] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:18.857792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.873159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa66d489-8b7f-47d3-82e8-2e702ee28db2 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.915054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33d61f-83b7-4533-8bb6-eadfcad2f232 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.921340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mfmxtX7MQ0G4SkC6827Eyg, audit_chain_id=['mfmxtX7MQ0G4SkC6827Eyg']) at 0x7fe8a1549160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.922020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.922299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.922569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.923329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.924929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.935546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 796/1590] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:18.935747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.940769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba36dd5-92f9-4e17-8640-6ee34a021035 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a1096f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.941516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36dd5-92f9-4e17-8640-6ee34a021035 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.941800 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36dd5-92f9-4e17-8640-6ee34a021035 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.942078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba36dd5-92f9-4e17-8640-6ee34a021035 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.942800 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba36dd5-92f9-4e17-8640-6ee34a021035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.944730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba36dd5-92f9-4e17-8640-6ee34a021035 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.945365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e791d10-31ec-4fd2-9d58-64cbdb785190 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.949943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=akw78cWOSVuF9l5PvCTRcA, audit_chain_id=['akw78cWOSVuF9l5PvCTRcA']) at 0x7fe8a1790490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.950593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.950874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.951147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.951821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.953742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:18.966167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 795/1591] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.967662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.968016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.968295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.979190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 797/1592] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:18.981082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:18.990864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b189f7b-fed9-49c7-b4b2-077fa89b6234 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:18.991726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:18.993140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:18.995543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a1505940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:18.996204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:18.996485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:18.996828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:18.997521 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:18.999106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.001050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 796/1593] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:19.002088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.012952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3118e-f842-4136-9345-6ee464553eb5 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.016640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 798/1594] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.016640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.020123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a14e94f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.020792 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.021101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.021373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.022102 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.023762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.024629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc7d8a-2eeb-4612-b895-bad41878597f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.030405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a10495b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.031064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.031338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.031608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.032356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.033966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.035559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 797/1595] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.036375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.044257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 799/1596] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.045129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.046992 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4005a94-1406-4da0-86ac-9bc5eee12292 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.052063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a1129bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.052753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.053064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.053339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.054091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.054748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807834-e153-404f-9a5f-bd7b0dc8458d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.055680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.059303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mfmxtX7MQ0G4SkC6827Eyg, audit_chain_id=['mfmxtX7MQ0G4SkC6827Eyg']) at 0x7fe8a14d37f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.059949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.060223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.060491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.061231 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.062815 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.066390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 798/1597] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.067289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.076590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 800/1598] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.076590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.078718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c951844b-1c6c-47ba-b131-a8533088793a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.083299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a1a0cfa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.083956 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.084079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbcddd-934f-4ea8-8262-fc971ce6954c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.084238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.084512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.085388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.086973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.088517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=akw78cWOSVuF9l5PvCTRcA, audit_chain_id=['akw78cWOSVuF9l5PvCTRcA']) at 0x7fe8a1434670>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.089201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.089500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.090317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.091031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.092594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.101295 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 799/1599] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.102416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.103098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 801/1600] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.103919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.114179 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936eb4c-c045-4eae-988b-2dc1179cb137 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.118765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a102f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.119412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.119690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.119962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.120697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.122532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.132805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 802/1601] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.133716 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.144493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea5968-80f0-481e-bf8a-68612eae211b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.149093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a14fb520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.149996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.150275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.150548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.151294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.154517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.160148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b04e7-a55d-4994-a5b8-914af167935e admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.163741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a14e9730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.164386 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.164668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.164862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 803/1602] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.165048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.165757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.175515 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404daf2d-13f2-447b-a4d5-8270e70f7334 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.175805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.177963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.180486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a102f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.181389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.181666 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.181942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] PATH_INFO: `/v3/projects/b91973a432b846db8bb07d1f668b88bf/users/411f13f8ba4b48dd972756373d9a8424/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.183988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b91973a432b846db8bb07d1f668b88bf, user_id=411f13f8ba4b48dd972756373d9a8424, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.196504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.196705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 800/1603] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:19.196705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.200307 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 804/1604] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/b91973a432b846db8bb07d1f668b88bf/users/411f13f8ba4b48dd972756373d9a8424/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.201148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.207827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f154d2dc-6b76-4479-be0c-0f96fa6b4439 service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.286571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a14e4130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.288394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.289111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.289254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fb1cc-67aa-4299-bc5a-e2f7de91e482 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.289839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] PATH_INFO: `/v3/projects/739aea76b0ad43cabcf21da1340afc55/users/d99bcdb71cd04ca59b3e8057697b2a77/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.294987 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mfmxtX7MQ0G4SkC6827Eyg, audit_chain_id=['mfmxtX7MQ0G4SkC6827Eyg']) at 0x7fe8a15792e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.296130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.296327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.297159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] PATH_INFO: `/v3/projects/58bddca6077344bea4cb41b23fcf8d35/users/fbad87a0396f4deb92f4da676af8bfdb/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.315113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=739aea76b0ad43cabcf21da1340afc55, user_id=d99bcdb71cd04ca59b3e8057697b2a77, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.320330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.324196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=58bddca6077344bea4cb41b23fcf8d35, user_id=fbad87a0396f4deb92f4da676af8bfdb, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.328668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.342331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 801/1605] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/739aea76b0ad43cabcf21da1340afc55/users/d99bcdb71cd04ca59b3e8057697b2a77/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.349980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.351848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 805/1606] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/58bddca6077344bea4cb41b23fcf8d35/users/fbad87a0396f4deb92f4da676af8bfdb/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.356280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.438636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10c5cc-b5f3-41f6-a7a1-4f335b0da72d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.444994 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a11e94f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.445684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.446032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.446491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.447872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.448455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c9cd9-676c-4e0e-a7f7-b56ee29affcc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.450732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.455434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=akw78cWOSVuF9l5PvCTRcA, audit_chain_id=['akw78cWOSVuF9l5PvCTRcA']) at 0x7fe8a1790490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.456112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.456390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.456661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.457420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.459024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.466210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 802/1607] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.466210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.475422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 806/1608] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:19.475422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.475719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d1a9d-56f6-492e-a374-2da17367c5fb admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.481798 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc02a4a-c167-479d-8080-405a844c3d47 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a1139370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.482853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02a4a-c167-479d-8080-405a844c3d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.483125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02a4a-c167-479d-8080-405a844c3d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.483400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc02a4a-c167-479d-8080-405a844c3d47 admin admin] PATH_INFO: `/v3/projects/8494cd6cad1a4855ac2bc0c2ebf724cf/users/4dad0e1d34a649bd999ecacc40b02062/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.485942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c07c14-f416-4caf-9116-f264b68a508f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.491524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46b7eab-4dac-4c44-a837-88f4f2ddbd5c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a1b73610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.492439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7eab-4dac-4c44-a837-88f4f2ddbd5c admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.492757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7eab-4dac-4c44-a837-88f4f2ddbd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.493643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46b7eab-4dac-4c44-a837-88f4f2ddbd5c admin admin] PATH_INFO: `/v3/projects/612784cc2dcc45b1b71ec19fc213f48f/users/5cbe87047c574127861cf1e4944c0fff/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.499675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc02a4a-c167-479d-8080-405a844c3d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8494cd6cad1a4855ac2bc0c2ebf724cf, user_id=4dad0e1d34a649bd999ecacc40b02062, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.502392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc02a4a-c167-479d-8080-405a844c3d47 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.510454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b7eab-4dac-4c44-a837-88f4f2ddbd5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=612784cc2dcc45b1b71ec19fc213f48f, user_id=5cbe87047c574127861cf1e4944c0fff, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.513297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46b7eab-4dac-4c44-a837-88f4f2ddbd5c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.519592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 803/1609] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/8494cd6cad1a4855ac2bc0c2ebf724cf/users/4dad0e1d34a649bd999ecacc40b02062/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.521128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.521553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.521847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.541337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 807/1610] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/612784cc2dcc45b1b71ec19fc213f48f/users/5cbe87047c574127861cf1e4944c0fff/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.541337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c96f-0702-4603-b938-f025384c6f94 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.541337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c96f-0702-4603-b938-f025384c6f94 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.541337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c96f-0702-4603-b938-f025384c6f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.561724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] MFA Rules not processed for user `411f13f8ba4b48dd972756373d9a8424`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:19.563082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:19.565134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-df67c96f-0702-4603-b938-f025384c6f94 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:19.566731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-df67c96f-0702-4603-b938-f025384c6f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:19.645436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 808/1611] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:19.648255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931e77-37c7-4e52-8e80-ba8c6129d10d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.648663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931e77-37c7-4e52-8e80-ba8c6129d10d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.649083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6931e77-37c7-4e52-8e80-ba8c6129d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.663309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 804/1612] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:19.664458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.676195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b8aaa-4f7e-4daf-8ca6-270023bea367 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.681894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a11e9130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.682786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.683059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.683613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] PATH_INFO: `/v3/projects/96ccf20c7ebb44e0be31671de1dd1ae1/users/75417f271c6947619c217483763c04f4/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.696519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d6931e77-37c7-4e52-8e80-ba8c6129d10d None None] MFA Rules not processed for user `d99bcdb71cd04ca59b3e8057697b2a77`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:19.697829 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d6931e77-37c7-4e52-8e80-ba8c6129d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:19.702460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ccf20c7ebb44e0be31671de1dd1ae1, user_id=75417f271c6947619c217483763c04f4, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.705520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.721552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 805/1613] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/96ccf20c7ebb44e0be31671de1dd1ae1/users/75417f271c6947619c217483763c04f4/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.725954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.775612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 809/1614] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:19.776971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.778176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.778594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.801985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49acc9d1-1799-42d3-9b27-cde41678314d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:19.806007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] MFA Rules not processed for user `4dad0e1d34a649bd999ecacc40b02062`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:19.807207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:19.807321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01947e-c481-47f6-a61a-e0ce8b14510a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=akw78cWOSVuF9l5PvCTRcA, audit_chain_id=['akw78cWOSVuF9l5PvCTRcA']) at 0x7fe8a1129ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:19.808155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01947e-c481-47f6-a61a-e0ce8b14510a admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.808492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01947e-c481-47f6-a61a-e0ce8b14510a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.808818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01947e-c481-47f6-a61a-e0ce8b14510a admin admin] PATH_INFO: `/v3/projects/7ec55859792345359fc7b22003b4e995/users/b8c8941361fb4800ad0574237c9ac377/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.824877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01947e-c481-47f6-a61a-e0ce8b14510a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec55859792345359fc7b22003b4e995, user_id=b8c8941361fb4800ad0574237c9ac377, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:19.827566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d01947e-c481-47f6-a61a-e0ce8b14510a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:19.843362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 806/1615] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:19 2022] PUT /identity/v3/projects/7ec55859792345359fc7b22003b4e995/users/b8c8941361fb4800ad0574237c9ac377/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:19.845037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:19.845552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:19.845922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:19.864239 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:19.865558 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:19.902652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 810/1616] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:19.904616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.986371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 807/1617] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:19.988289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:19.995488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb5d13-40e4-423c-9a96-abbe496784be None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.060135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76edf2b2-d5a0-41b6-8be0-288966fe56cc None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.064110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a10e1b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.064773 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.065064 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.065425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.066182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b740288-919b-44e5-b824-3557149a03ff service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a13bfc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.066923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740288-919b-44e5-b824-3557149a03ff service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.067387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740288-919b-44e5-b824-3557149a03ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.067794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b740288-919b-44e5-b824-3557149a03ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.084508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740288-919b-44e5-b824-3557149a03ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.086777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b740288-919b-44e5-b824-3557149a03ff service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.105244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 811/1618] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:20.106884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b91fb-6259-4f5e-83a6-0163075662eb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.107178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b91fb-6259-4f5e-83a6-0163075662eb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.107459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b91fb-6259-4f5e-83a6-0163075662eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.136144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.138631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.142095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9a4b91fb-6259-4f5e-83a6-0163075662eb None None] MFA Rules not processed for user `75417f271c6947619c217483763c04f4`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:20.143796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a4b91fb-6259-4f5e-83a6-0163075662eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:20.156429 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 808/1619] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:20.157929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.170414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae4530b-3fed-43f6-a16a-966c154a592d service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.176411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81856404-8fb7-4322-8f7c-29385b05308d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a2522250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.177250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856404-8fb7-4322-8f7c-29385b05308d admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.177612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856404-8fb7-4322-8f7c-29385b05308d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.178244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81856404-8fb7-4322-8f7c-29385b05308d admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.179527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856404-8fb7-4322-8f7c-29385b05308d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.182030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81856404-8fb7-4322-8f7c-29385b05308d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.222091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 812/1620] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:20.223806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.224122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.224373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.230358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 809/1621] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:20.230358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fac0-e8eb-49a6-8b16-0aba1d8693ef None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.231029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fac0-e8eb-49a6-8b16-0aba1d8693ef None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.231743 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2165fac0-e8eb-49a6-8b16-0aba1d8693ef None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.247179 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 810/1622] 10.222.0.49 () {54 vars in 961 bytes} [Fri May 13 12:54:20 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:20.249598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fac0-e8eb-49a6-8b16-0aba1d8693ef None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.253171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:20.255064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:20.388702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 813/1623] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:20.389920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2165fac0-e8eb-49a6-8b16-0aba1d8693ef None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.390537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.395472 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1821430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.396492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.396851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.397308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.403891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48ff09-5646-41e7-9712-ba9c1fd590ab None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.409514 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4327c2-7fd3-4e0c-ac1c-24d9f5e94dd8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a151d2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.410823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4327c2-7fd3-4e0c-ac1c-24d9f5e94dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.421583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.421962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4327c2-7fd3-4e0c-ac1c-24d9f5e94dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.422152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4327c2-7fd3-4e0c-ac1c-24d9f5e94dd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.423279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.424645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4327c2-7fd3-4e0c-ac1c-24d9f5e94dd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.429111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4327c2-7fd3-4e0c-ac1c-24d9f5e94dd8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.437889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 811/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:20.438810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.466305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f829a7-585b-44b0-b7f3-201c3058ee82 service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.481102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 814/1625] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/projects => generated 405 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:20.483913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.484292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a1c5caf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.484813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.485947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.486270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.487040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.487624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.489804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.492708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.545212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 812/1626] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/users => generated 291 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:20.547626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.547963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:20.549408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:20.552746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:20.574760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af28aa39-31ff-4863-abf6-9b85915930a4 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.666260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1c72fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.666847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.667576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.668388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.759217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 815/1627] 10.222.0.49 () {58 vars in 1058 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:20.760184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.803392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.805612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.822027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 813/1628] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:20.823180 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.835696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad3415f-7379-4cce-8ea2-d9ac9bc77067 service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.840943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a14e4070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.842055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.843600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.843894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.844644 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.846856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:20.877645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 814/1629] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:20.878526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:20.929976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06922a2-51f3-4fc8-a531-f1e1802c7898 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.939595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f158e-f4f8-472b-b57a-5290240bfca1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:20.945859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=WXCHqpg1TouWC97W_DBeTQ, audit_chain_id=['WXCHqpg1TouWC97W_DBeTQ']) at 0x7fe8a1096370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.947290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.947581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.948419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.956158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a1549160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:20.958712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:20.959369 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:20.959679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:20.962826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:20.967680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.007087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 816/1630] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:20 2022] POST /identity/v3/users => generated 309 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:21.010245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.023723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c4860-f235-45fd-9fce-f5f270091c23 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.031952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a1541fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.033230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.033692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.034213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] PATH_INFO: `/v3/projects/8e542b961fb14cee841b0b584385d909/users/8ced258df4454d659ea6800545fefa4f/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.043471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.045884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.058227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 815/1631] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:21.059844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.073006 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef208d0f-4c07-4642-ad3b-0d6b20cd7276 service nova] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.075041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e542b961fb14cee841b0b584385d909, user_id=8ced258df4454d659ea6800545fefa4f, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.080557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a11ed6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.082222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.082737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.082917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.083029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] PATH_INFO: `/v3/users/5f05322a0a024599bccf855997b0b2f0` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.084355 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f05322a0a024599bccf855997b0b2f0)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.085513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: WARNING py.warnings [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:54:21.085513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: warnings.warn(msg) May 13 12:54:21.085513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: May 13 12:54:21.087791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.117701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 817/1632] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:21 2022] PUT /identity/v3/projects/8e542b961fb14cee841b0b584385d909/users/8ced258df4454d659ea6800545fefa4f/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:21.122200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.219837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f05322a0a024599bccf855997b0b2f0'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:21.220688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f05322a0a024599bccf855997b0b2f0'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:21.221345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f05322a0a024599bccf855997b0b2f0'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:21.254366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625db8d3-e24a-4c3e-b69b-79a63e3ca3a0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.260031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a14c60a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.260771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.261241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.262324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.263379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.265694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.278459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f05322a0a024599bccf855997b0b2f0'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:21.293112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 818/1633] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:21.293112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.295424 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.299181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f05322a0a024599bccf855997b0b2f0'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:21.313168 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f472-9828-44b6-94cd-3b9603b769ed admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.319480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4495689-3d50-458d-be39-ddbf4efaf62f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a1790490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.320465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495689-3d50-458d-be39-ddbf4efaf62f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.321018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495689-3d50-458d-be39-ddbf4efaf62f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.321240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4495689-3d50-458d-be39-ddbf4efaf62f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.322236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495689-3d50-458d-be39-ddbf4efaf62f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.324576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4495689-3d50-458d-be39-ddbf4efaf62f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.342458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 816/1634] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:21 2022] DELETE /identity/v3/users/5f05322a0a024599bccf855997b0b2f0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:21.342458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.347166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.347618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 819/1635] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:21.350061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.350990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.351596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.376871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:21.380018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.519436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78732fdc-2a0a-4a47-ac8f-cd9749fb7541 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.533772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 820/1636] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:21.535019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.538603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5adf14a-fab7-49e8-bc36-5f42ba51eccc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a10e1ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.539821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adf14a-fab7-49e8-bc36-5f42ba51eccc admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.540310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adf14a-fab7-49e8-bc36-5f42ba51eccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.541328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5adf14a-fab7-49e8-bc36-5f42ba51eccc admin admin] PATH_INFO: `/v3/projects/411d8378162d4e5f9d0ea1dd60a21cfe/users/e0c79edcfe3b4c3a90f471e503720266/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.557776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973be24-bb46-470f-b4c8-8ea5ab4f969f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.564393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64390c97-dcd5-4257-a3cc-9c7783733330 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a31910a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.574742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390c97-dcd5-4257-a3cc-9c7783733330 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.576144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adf14a-fab7-49e8-bc36-5f42ba51eccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=411d8378162d4e5f9d0ea1dd60a21cfe, user_id=e0c79edcfe3b4c3a90f471e503720266, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.578661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390c97-dcd5-4257-a3cc-9c7783733330 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.579332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64390c97-dcd5-4257-a3cc-9c7783733330 admin admin] PATH_INFO: `/v3/projects/8e542b961fb14cee841b0b584385d909/users/8ced258df4454d659ea6800545fefa4f/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.582038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5adf14a-fab7-49e8-bc36-5f42ba51eccc admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.594565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64390c97-dcd5-4257-a3cc-9c7783733330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e542b961fb14cee841b0b584385d909, user_id=8ced258df4454d659ea6800545fefa4f, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.598965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64390c97-dcd5-4257-a3cc-9c7783733330 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.611536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 817/1637] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:21 2022] PUT /identity/v3/projects/411d8378162d4e5f9d0ea1dd60a21cfe/users/e0c79edcfe3b4c3a90f471e503720266/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:21.621721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af5fe8-67fb-4ac1-823f-92ac86bb2081 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.621957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af5fe8-67fb-4ac1-823f-92ac86bb2081 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.622276 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af5fe8-67fb-4ac1-823f-92ac86bb2081 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.623846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 818/1639] 10.222.0.49 () {54 vars in 912 bytes} [Fri May 13 12:54:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:21.624445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af5fe8-67fb-4ac1-823f-92ac86bb2081 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.631506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 821/1639] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:21 2022] PUT /identity/v3/projects/8e542b961fb14cee841b0b584385d909/users/8ced258df4454d659ea6800545fefa4f/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:21.646216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.646531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.646991 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.710238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] MFA Rules not processed for user `8ced258df4454d659ea6800545fefa4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:21.712315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.778161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af5fe8-67fb-4ac1-823f-92ac86bb2081 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.784255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f48fd0-cc21-4a98-a989-2db70f855ffc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a151c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.785715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48fd0-cc21-4a98-a989-2db70f855ffc admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.788130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48fd0-cc21-4a98-a989-2db70f855ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.788927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f48fd0-cc21-4a98-a989-2db70f855ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.790620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f48fd0-cc21-4a98-a989-2db70f855ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.794554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f48fd0-cc21-4a98-a989-2db70f855ffc admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.812381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 819/1640] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:21 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:21.814943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.815452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.815943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.824798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 822/1641] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:21.826056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.828075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.847714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:21.849822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.908099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ca18f-e385-42ee-8bf2-53e67b07ea44 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:21.914190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1501d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:21.915010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:21.915492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:21.915854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:21.928308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:21.929901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:21.942038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 820/1642] 10.222.0.49 () {58 vars in 1009 bytes} [Fri May 13 12:54:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:21.943190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.943484 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 823/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:21.944341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:21.946617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:21.990332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177a97-20ff-4d6a-90b1-60927439ee16 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:22.002111 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a11ca8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:22.004125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:22.004641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:22.005272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] PATH_INFO: `/v3/projects/411d8378162d4e5f9d0ea1dd60a21cfe/users/e0c79edcfe3b4c3a90f471e503720266/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:22.009461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] RBAC: Authorizing `identity:create_grant(project_id=411d8378162d4e5f9d0ea1dd60a21cfe, user_id=e0c79edcfe3b4c3a90f471e503720266, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:22.014836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:22.031935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 821/1644] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:21 2022] PUT /identity/v3/projects/411d8378162d4e5f9d0ea1dd60a21cfe/users/e0c79edcfe3b4c3a90f471e503720266/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:22.033345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:22.039240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:22.052198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f255ba-a245-41f8-af27-6e869318dc04 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:22.133199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a336d69-c97f-4e5e-9269-36dc8659260f admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:22.141528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1190070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:22.142207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:22.142482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:22.142759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:22.146310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5afedb-79ae-43a1-95fc-ecc530e8ea8e service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a14f7700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:22.146979 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afedb-79ae-43a1-95fc-ecc530e8ea8e service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:22.147258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afedb-79ae-43a1-95fc-ecc530e8ea8e service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:22.147530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5afedb-79ae-43a1-95fc-ecc530e8ea8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:22.298166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afedb-79ae-43a1-95fc-ecc530e8ea8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:22.302253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5afedb-79ae-43a1-95fc-ecc530e8ea8e service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:22.305226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:22.306912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:22.318569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 824/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:21 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:22.320217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:22.320508 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:22.320916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:22.326026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 822/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:22.363680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] MFA Rules not processed for user `e0c79edcfe3b4c3a90f471e503720266`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:22.365623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:22.421528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:22.440070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a6be7-01fb-4e11-bafd-8e760b06f8a3 service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:22.448251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a1032310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:22.449789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:22.450190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:22.450579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:22.454270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:22.563692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 825/1647] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:22 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:22.564975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:22.569178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:22.600413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:22.604110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:22.620835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 823/1648] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:22.798150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea9417-d1b5-43b6-ac10-56f8a877a9f7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:22.815481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1512340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:22.822020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:22.822325 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:22.822688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] PATH_INFO: `/v3/projects/6dd8a886a6ac4878b0dd960ce0a448a7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:22.826952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd8a886a6ac4878b0dd960ce0a448a7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:22.828035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 13 12:54:22.828035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: warnings.warn(msg) May 13 12:54:22.828035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: May 13 12:54:22.829383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:22.956091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd8a886a6ac4878b0dd960ce0a448a7', 'request_id': 'req-fb7ec574-b612-4751-9d95-33cb1ef7d501'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:22.985143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd8a886a6ac4878b0dd960ce0a448a7', 'request_id': 'req-fb7ec574-b612-4751-9d95-33cb1ef7d501'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:22.993258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd8a886a6ac4878b0dd960ce0a448a7', 'request_id': 'req-fb7ec574-b612-4751-9d95-33cb1ef7d501'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.035540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] The token cache is being invalidate because project 6dd8a886a6ac4878b0dd960ce0a448a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:23.035828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.037499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fb7ec574-b612-4751-9d95-33cb1ef7d501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.042773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 826/1649] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:22 2022] DELETE /identity/v3/projects/6dd8a886a6ac4878b0dd960ce0a448a7 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:23.044405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:23.060134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4804-df6a-42a8-ae5c-5a7eaceaea8b service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:23.148282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf232-2626-4f6a-8d5a-7f0266b241aa None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.148587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf232-2626-4f6a-8d5a-7f0266b241aa None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.148847 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbf232-2626-4f6a-8d5a-7f0266b241aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.194007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-73cbf232-2626-4f6a-8d5a-7f0266b241aa None None] MFA Rules not processed for user `5cbe87047c574127861cf1e4944c0fff`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:23.197375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-73cbf232-2626-4f6a-8d5a-7f0266b241aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:23.217958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1524f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:23.219194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.221681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.222367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] PATH_INFO: `/v3/users/411f13f8ba4b48dd972756373d9a8424` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.224658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] RBAC: Authorizing `identity:delete_user(user_id=411f13f8ba4b48dd972756373d9a8424)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:23.231211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:23.321184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 827/1650] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:23.340170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e35e-897a-4514-925b-066a5b1f49d7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.340749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e35e-897a-4514-925b-066a5b1f49d7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.341605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e35e-897a-4514-925b-066a5b1f49d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.352068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '411f13f8ba4b48dd972756373d9a8424'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.356868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '411f13f8ba4b48dd972756373d9a8424'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.359600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '411f13f8ba4b48dd972756373d9a8424'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.401685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5a14e35e-897a-4514-925b-066a5b1f49d7 None None] MFA Rules not processed for user `5cbe87047c574127861cf1e4944c0fff`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:23.403885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '411f13f8ba4b48dd972756373d9a8424'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.404704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5a14e35e-897a-4514-925b-066a5b1f49d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:23.424229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '411f13f8ba4b48dd972756373d9a8424'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:23.428885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 828/1651] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:23.448007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55ba2-a188-4ff4-b17e-e37d2a629676 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.448601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55ba2-a188-4ff4-b17e-e37d2a629676 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.449311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55ba2-a188-4ff4-b17e-e37d2a629676 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.452289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 829/1652] 10.222.0.49 () {54 vars in 961 bytes} [Fri May 13 12:54:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:54:23.455469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 824/1653] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:23 2022] DELETE /identity/v3/users/411f13f8ba4b48dd972756373d9a8424 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:23.461346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.461633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.461913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.507297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:23.509014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:23.549806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:23.551688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:23.649346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 830/1654] 10.222.0.49 () {58 vars in 1058 bytes} [Fri May 13 12:54:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:23.649992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:23.663057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b7e3e1-b414-497d-9602-3ab75bddd9f5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:23.671581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=4ienQcP1R_2SwULFfmkyyw, audit_chain_id=['4ienQcP1R_2SwULFfmkyyw']) at 0x7fe8a100ad60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:23.672662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.673282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.673796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.676071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:23.722998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5497a18-46b5-4ced-98ef-1481b73a804e admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:23.732312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a19a3580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:23.733361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:23.740399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:23.740912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:23.747201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:23.757029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:23.759262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836c24f-ebbb-4a7c-b081-e4365973084e service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:23.784923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 831/1655] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:23.967110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:23.973573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:24.014374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 825/1656] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:23 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:24.191966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a7db-53d4-4e8f-9fd4-7f82afc70282 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.192882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a7db-53d4-4e8f-9fd4-7f82afc70282 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.193226 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4a7db-53d4-4e8f-9fd4-7f82afc70282 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.195705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 832/1657] 10.222.0.49 () {54 vars in 912 bytes} [Fri May 13 12:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:24.206621 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:24.208406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.210968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.211257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.211561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.254835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:24.256356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.275769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 833/1658] 10.222.0.49 () {58 vars in 1009 bytes} [Fri May 13 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:24.286336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:24.289298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.324912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83186d48-4984-4749-8869-0e41877236bb service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:24.332911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NTraEs4ORxGGjvFCmaoLRQ, audit_chain_id=['NTraEs4ORxGGjvFCmaoLRQ']) at 0x7fe8a1464af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:24.334093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.334504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.334886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] PATH_INFO: `/v3/projects/b91973a432b846db8bb07d1f668b88bf` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.336643 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b91973a432b846db8bb07d1f668b88bf)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:24.339070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:24.388609 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2166b231-7dc2-44a1-961e-b1e05f5935e8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:24.401465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=g_C7-r29Sf-wds4KLJUeQw, audit_chain_id=['g_C7-r29Sf-wds4KLJUeQw']) at 0x7fe8a153b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296ed9d38ea741b1bc2c72fc398b5009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:24.402117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.404053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.405301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.421223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:24.422420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b91973a432b846db8bb07d1f668b88bf', 'request_id': 'req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.423713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:24.434866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b91973a432b846db8bb07d1f668b88bf', 'request_id': 'req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.451886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 834/1659] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:54:24.452888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:24.455242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.470037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b91973a432b846db8bb07d1f668b88bf', 'request_id': 'req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.488704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae7862-524f-455a-aadc-e555f056edb6 service glance] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:24.510116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] The token cache is being invalidate because project b91973a432b846db8bb07d1f668b88bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:24.510423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.512367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b40e7cef-fe9e-4e67-87ea-c81def15fbb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.528610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 826/1660] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:24 2022] DELETE /identity/v3/projects/b91973a432b846db8bb07d1f668b88bf => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:24.531156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39c2bd-a7d2-4b13-9e91-3ce92af596d6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.531494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39c2bd-a7d2-4b13-9e91-3ce92af596d6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.531765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b39c2bd-a7d2-4b13-9e91-3ce92af596d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.559882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5b39c2bd-a7d2-4b13-9e91-3ce92af596d6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:24.561373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5b39c2bd-a7d2-4b13-9e91-3ce92af596d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.626913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a151d2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:24.628450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.628751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.629053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] PATH_INFO: `/v3/users/75417f271c6947619c217483763c04f4` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.638720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] RBAC: Authorizing `identity:delete_user(user_id=75417f271c6947619c217483763c04f4)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:24.640739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:24.717783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 827/1661] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:24.719554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.719915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.720307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.744031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75417f271c6947619c217483763c04f4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.746568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:24.749000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75417f271c6947619c217483763c04f4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.749195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.752945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75417f271c6947619c217483763c04f4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.759685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 828/1662] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:24.765145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:24.776761 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01988b52-f3d5-4b05-b2bb-4ca8ae095ad7 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:24.782417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75417f271c6947619c217483763c04f4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.784363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a151c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:24.785195 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.785478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.785749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.786490 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:24.786790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:24.789335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:24.803992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-85a27150-add5-4b47-a24c-4b79fa88edac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75417f271c6947619c217483763c04f4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:24.807706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 829/1663] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:24.810526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:24.822603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6da4-b764-48dd-a334-7b8b89eb7506 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:24.828490 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a160cfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:24.828972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.829540 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.830024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.831162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:24.833043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 835/1664] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:24 2022] DELETE /identity/v3/users/75417f271c6947619c217483763c04f4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:24.837607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:24.837883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:24.838156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:24.839692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:24.877736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:24.882543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:24.901486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 830/1665] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:24 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:24.906581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:25.073138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 836/1666] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:25.103035 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:25.105267 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:25.129852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52b3e5-48c2-4d3f-a5b9-26702a1d565a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:25.150489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459af1b-20cf-4e11-b34f-33b194ab0511 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a10197f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:25.151308 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459af1b-20cf-4e11-b34f-33b194ab0511 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.151593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459af1b-20cf-4e11-b34f-33b194ab0511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.151863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459af1b-20cf-4e11-b34f-33b194ab0511 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.154380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459af1b-20cf-4e11-b34f-33b194ab0511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:25.155899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459af1b-20cf-4e11-b34f-33b194ab0511 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:25.194632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 831/1667] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:24 2022] POST /identity/v3/users => generated 283 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:54:25.196857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c24e-6e5d-4905-8f51-dabe54a9bdb6 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.197193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c24e-6e5d-4905-8f51-dabe54a9bdb6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.197470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8c24e-6e5d-4905-8f51-dabe54a9bdb6 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.201135 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 832/1668] 10.222.0.49 () {54 vars in 912 bytes} [Fri May 13 12:54:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:25.205976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c24e-6e5d-4905-8f51-dabe54a9bdb6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:25.239615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8c24e-6e5d-4905-8f51-dabe54a9bdb6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:25.259374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130f495-1df9-445a-985b-ec006ca54987 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a14e4ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:25.263901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130f495-1df9-445a-985b-ec006ca54987 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.266147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130f495-1df9-445a-985b-ec006ca54987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.267241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130f495-1df9-445a-985b-ec006ca54987 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.269430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130f495-1df9-445a-985b-ec006ca54987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:25.276818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130f495-1df9-445a-985b-ec006ca54987 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:25.277379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dee5de-8edc-4933-b3f1-478054ed4446 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:25.311845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 833/1669] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:25.315232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.315529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.317313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.420737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a10c9430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:25.421459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.421923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.422212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.423678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] MFA Rules not processed for user `40efb0126116472aabce8459ff59bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:25.425440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:25.438965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:25.440370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:25.443720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 834/1670] 10.222.0.49 () {58 vars in 1009 bytes} [Fri May 13 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:25.444659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:25.472293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 837/1671] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:25.473171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:25.475774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33a1d1-1ae3-48df-8b84-bbc5d8669cf6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:25.477706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:25.489649 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a11ca4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:25.489936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.490222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.490573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.491318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:25.502722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:25.515115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08e02c2-8036-49bf-b8cd-462752cd4e94 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:25.527553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 835/1672] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:25.529537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8ead-484d-4d3b-9c13-fe7951d649b3 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a13b7730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:25.530218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8ead-484d-4d3b-9c13-fe7951d649b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.530499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8ead-484d-4d3b-9c13-fe7951d649b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.530774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8ead-484d-4d3b-9c13-fe7951d649b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.532379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:25.548176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae8ead-484d-4d3b-9c13-fe7951d649b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:25.549694 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae8ead-484d-4d3b-9c13-fe7951d649b3 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:25.581734 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542599b-3e30-4cd7-ae0c-d4ad9966191b admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:25.598263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 838/1673] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:25.599076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a11e93d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:25.603068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.603068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.605865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] PATH_INFO: `/v3/projects/c548cd7de7ab49559612a700ff986ec7/users/21205f7e5b4d497393e39930239c62cc/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.638030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c548cd7de7ab49559612a700ff986ec7, user_id=21205f7e5b4d497393e39930239c62cc, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:25.641022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:25.689975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 836/1674] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:25 2022] PUT /identity/v3/projects/c548cd7de7ab49559612a700ff986ec7/users/21205f7e5b4d497393e39930239c62cc/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:25.690269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:25.690487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:25.690760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:25.740775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] MFA Rules not processed for user `21205f7e5b4d497393e39930239c62cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:25.743401 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:25.982258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 839/1675] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:25.988049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.158592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9761-98d3-4052-a9ae-8bc9635bacbd admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.179005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a1575430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.179891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.180177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.180454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.181201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.183176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.244297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 837/1676] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:25 2022] POST /identity/v3/projects => generated 363 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:26.244923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.265278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce1f28f-3c55-4c9f-9166-97ea4ca6c548 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.361362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a10a42b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.362240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.362676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.363021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.363853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.365948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.414889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 840/1677] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:26 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:54:26.417373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.435434 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf1f6-6365-4a61-92ab-7139075313fd admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.443008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea00e69-3b3b-4f78-afa8-83eedd37b585 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a19a84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.444082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00e69-3b3b-4f78-afa8-83eedd37b585 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.444423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00e69-3b3b-4f78-afa8-83eedd37b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.445048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea00e69-3b3b-4f78-afa8-83eedd37b585 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.445867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00e69-3b3b-4f78-afa8-83eedd37b585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.448320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea00e69-3b3b-4f78-afa8-83eedd37b585 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.473069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 838/1678] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:54:26.475320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.498692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf1ef7-83f6-4af9-a4eb-18a89cecbfb6 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.517921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a13dbe20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.519040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.519430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.520430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] PATH_INFO: `/v3/projects/22457a786ff84bfaaef6627af6f0aacb/users/a2c2e812220d45558cb4fd1897c50218/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.543089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c90af-472d-429a-911b-467e2d5f3e2b None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.543699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c90af-472d-429a-911b-467e2d5f3e2b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.543989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c90af-472d-429a-911b-467e2d5f3e2b None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.547652 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 839/1679] 10.222.0.49 () {54 vars in 960 bytes} [Fri May 13 12:54:26 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:54:26.556254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.557241 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.557395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.559752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=22457a786ff84bfaaef6627af6f0aacb, user_id=a2c2e812220d45558cb4fd1897c50218, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.562866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.600236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 841/1680] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:26 2022] PUT /identity/v3/projects/22457a786ff84bfaaef6627af6f0aacb/users/a2c2e812220d45558cb4fd1897c50218/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:26.601364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.607255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] MFA Rules not processed for user `00056de203d84284a032f715ef2d6a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:26.611004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:26.788797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96432b5-1e8d-4684-bcd1-1a2ff31fd6cb admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.800334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a10a42b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.801137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 840/1681] 10.222.0.49 () {58 vars in 1057 bytes} [Fri May 13 12:54:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:26.801699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.802009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.802530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.802998 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.803953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.804053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:26.809091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.836461 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 842/1682] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:26.837593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.857168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2118828-53d4-4b1a-80f3-6001ae21c66f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.863144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fbcfe-35bd-4d17-90b5-05595ae8c312 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:26.872212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a14cb2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.873253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.873542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.873873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] PATH_INFO: `/v3/users/4dad0e1d34a649bd999ecacc40b02062` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.877344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dad0e1d34a649bd999ecacc40b02062)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.877892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] RBAC: auth_context: {'token': <TokenModel (audit_id=PTU9mmJVTbyaC5nqZo_taw, audit_chain_id=['PTU9mmJVTbyaC5nqZo_taw']) at 0x7fe8a0fe3f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00056de203d84284a032f715ef2d6a3d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:26.878655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:26.879054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:26.879423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:26.879522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.882353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:26.911512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:26.913458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:26.962990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 843/1683] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:26.964104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:26.991054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2905788-73a7-4a14-a955-11abc3cdc2df service placement] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:27.015045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e42c4-2bdf-42c5-9777-eeb4d6e39d35 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a100ad60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:27.016110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e42c4-2bdf-42c5-9777-eeb4d6e39d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:27.016553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e42c4-2bdf-42c5-9777-eeb4d6e39d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:27.016931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e42c4-2bdf-42c5-9777-eeb4d6e39d35 admin admin] PATH_INFO: `/v3/projects/22457a786ff84bfaaef6627af6f0aacb/users/a2c2e812220d45558cb4fd1897c50218/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:27.033693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dad0e1d34a649bd999ecacc40b02062'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:27.034563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e42c4-2bdf-42c5-9777-eeb4d6e39d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22457a786ff84bfaaef6627af6f0aacb, user_id=a2c2e812220d45558cb4fd1897c50218, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:27.037420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dad0e1d34a649bd999ecacc40b02062'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:27.037838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e42c4-2bdf-42c5-9777-eeb4d6e39d35 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:27.038140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dad0e1d34a649bd999ecacc40b02062'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:27.076447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 844/1684] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:26 2022] PUT /identity/v3/projects/22457a786ff84bfaaef6627af6f0aacb/users/a2c2e812220d45558cb4fd1897c50218/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:27.088014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:27.088356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:27.088735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:27.096555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dad0e1d34a649bd999ecacc40b02062'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:27.124901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8563e1e7-cdc3-49fa-8fa3-aeac25a1a202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dad0e1d34a649bd999ecacc40b02062'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:27.187783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 841/1685] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:26 2022] DELETE /identity/v3/users/4dad0e1d34a649bd999ecacc40b02062 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:27.192555 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:27.192825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:27.193134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:27.199280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] MFA Rules not processed for user `a2c2e812220d45558cb4fd1897c50218`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:27.206587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:27.280376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:27.287010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:27.525703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 845/1686] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:27.539565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:27.541387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:27.544390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 842/1687] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:27.685905 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:27.687613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:27.725738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a3a88d-370e-4af7-b50e-ee27b5d736ce None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:27.749898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a153b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:27.750689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:27.751086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:27.751470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:27.793718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:27.795420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:27.818668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 846/1688] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:54:27.823210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53668f14-9d09-4b1a-bfa4-22d2e26c447b None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:27.832997 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1a32c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:27.833692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:27.833984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:27.834882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:27.860485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:27.862422 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:27.900288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 843/1689] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:27.969936 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:27.979970 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08098d8b-f20a-4590-ba05-60c2f2a9196c service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:27.990466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:27.991930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:27.994106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a103ad00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:27.997008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:27.997545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:27.998051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:28.002237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:28.026771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e7e77a-7b8e-438e-8105-009b4e7626ce service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:28.063189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a19bff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:28.064082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:28.064363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:28.066199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] PATH_INFO: `/v3/projects/96ccf20c7ebb44e0be31671de1dd1ae1` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:28.073619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ccf20c7ebb44e0be31671de1dd1ae1)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:28.079647 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:28.156845 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:28.173753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:28.213587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 847/1690] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:28.258403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ccf20c7ebb44e0be31671de1dd1ae1', 'request_id': 'req-c0745576-e152-4502-b2c7-a7809085fc87'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.287846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ccf20c7ebb44e0be31671de1dd1ae1', 'request_id': 'req-c0745576-e152-4502-b2c7-a7809085fc87'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.297965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ccf20c7ebb44e0be31671de1dd1ae1', 'request_id': 'req-c0745576-e152-4502-b2c7-a7809085fc87'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.356820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:28.361221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] The token cache is being invalidate because project 96ccf20c7ebb44e0be31671de1dd1ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:28.361631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.362319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:28.382201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.388210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 844/1691] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:27 2022] DELETE /identity/v3/projects/96ccf20c7ebb44e0be31671de1dd1ae1 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:28.389253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:28.390692 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:28.422447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625c849-9f50-42ca-963a-e00454d7bcf5 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:28.537632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0745576-e152-4502-b2c7-a7809085fc87 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:28.629269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a19bc490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:28.630301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:28.630591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:28.631009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] PATH_INFO: `/v3/users/e0c79edcfe3b4c3a90f471e503720266` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:28.641210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c79edcfe3b4c3a90f471e503720266)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:28.644784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:28.690509 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a102f430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:28.692296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:28.692786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:28.693269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] PATH_INFO: `/v3/users/d99bcdb71cd04ca59b3e8057697b2a77` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:28.698579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99bcdb71cd04ca59b3e8057697b2a77)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:28.707118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:28.810695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99bcdb71cd04ca59b3e8057697b2a77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.814176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99bcdb71cd04ca59b3e8057697b2a77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.815622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99bcdb71cd04ca59b3e8057697b2a77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.818972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c79edcfe3b4c3a90f471e503720266'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.821544 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c79edcfe3b4c3a90f471e503720266'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.823429 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c79edcfe3b4c3a90f471e503720266'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.848786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99bcdb71cd04ca59b3e8057697b2a77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.860532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c79edcfe3b4c3a90f471e503720266'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.869303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c78044d1-c900-4e9b-bfb1-dbfc2f31ee49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99bcdb71cd04ca59b3e8057697b2a77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.874903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c79edcfe3b4c3a90f471e503720266'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:28.888725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 848/1692] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:28 2022] DELETE /identity/v3/users/d99bcdb71cd04ca59b3e8057697b2a77 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:28.890503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:28.890791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:28.891065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:28.910389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 845/1693] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:28 2022] DELETE /identity/v3/users/e0c79edcfe3b4c3a90f471e503720266 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:28.921620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:28.923072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:29.042637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 849/1694] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:29.104797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:29.107639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:29.212809 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64c334-4858-4aca-a02a-8874cc28a2d6 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:29.223388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c760314-371b-40e6-9c43-2293f251f428 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1019b20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:29.223388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760314-371b-40e6-9c43-2293f251f428 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:29.223715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760314-371b-40e6-9c43-2293f251f428 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:29.223955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c760314-371b-40e6-9c43-2293f251f428 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:29.241636 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c760314-371b-40e6-9c43-2293f251f428 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:29.243377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c760314-371b-40e6-9c43-2293f251f428 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:29.256036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 846/1695] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:30.307252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:30.309321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:30.336957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db0af-02e8-42f9-8af0-94fe0dfa04dc None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:30.358416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=392TRy_USemQu-wy1wgmHQ, audit_chain_id=['392TRy_USemQu-wy1wgmHQ']) at 0x7fe8a14c0190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:30.358637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:30.358910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:30.359027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] PATH_INFO: `/v3/projects/8494cd6cad1a4855ac2bc0c2ebf724cf` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:30.363839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8494cd6cad1a4855ac2bc0c2ebf724cf)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:30.373918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:30.469446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8494cd6cad1a4855ac2bc0c2ebf724cf', 'request_id': 'req-24f71041-6040-4441-b5c5-3b5af7b5517f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:30.481962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8494cd6cad1a4855ac2bc0c2ebf724cf', 'request_id': 'req-24f71041-6040-4441-b5c5-3b5af7b5517f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:30.490332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8494cd6cad1a4855ac2bc0c2ebf724cf', 'request_id': 'req-24f71041-6040-4441-b5c5-3b5af7b5517f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:30.505157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] The token cache is being invalidate because project 8494cd6cad1a4855ac2bc0c2ebf724cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:30.505493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:30.506200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-24f71041-6040-4441-b5c5-3b5af7b5517f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:30.508290 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 850/1696] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:30 2022] DELETE /identity/v3/projects/8494cd6cad1a4855ac2bc0c2ebf724cf => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:30.514303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:30.514303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:30.514303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:30.565945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:30.567192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:30.659797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 847/1697] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:30.667333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:30.668539 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:30.669082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:30.716272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:30.717501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:30.753188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 851/1698] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:30.758576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:30.771161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1620ed-4b31-4336-af84-a77536abb69e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:30.785534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a1561700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:30.788755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:30.789744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:30.790334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:30.792511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:30.793542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:30.797826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576a195-a5c3-4f39-9f76-0cba96db61f3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:30.842405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 848/1699] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:30.843565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:30.861353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e31837-ea22-4ac4-80a6-dc43a7edb9eb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:30.891737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a109c580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:30.892834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:30.893816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:30.894770 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:30.896064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:30.898095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:30.924557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:30.925564 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:30.926009 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:30.961701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] MFA Rules not processed for user `2efb260599b1451dba561f50c3f895e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:30.963048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:30.966187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 852/1700] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:30 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:30.969944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.093335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 849/1701] 10.222.0.49 () {58 vars in 1009 bytes} [Fri May 13 12:54:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:31.112474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c182f54b-86c1-4eba-9b56-23877f6d819b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.124403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a103a310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.125341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.125626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.126848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.128041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:31.131309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:31.164739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.171477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 853/1702] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:30 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:54:31.177699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.184657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:31.186702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b231fdf-435b-4202-ae1a-739a13dd7ed1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.200367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a1f5ff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.201105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.204040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.208085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.208898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:31.212839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:31.223367 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ccc71-f732-4d6f-8d63-1e08c038dad4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.235239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=n411qgi7S-iFHW3yDz9ORg, audit_chain_id=['n411qgi7S-iFHW3yDz9ORg']) at 0x7fe8a0fd7640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.239255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.239255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.239549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] PATH_INFO: `/v3/projects/411d8378162d4e5f9d0ea1dd60a21cfe` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.244821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 850/1703] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:31.245602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] RBAC: Authorizing `identity:delete_project(project_id=411d8378162d4e5f9d0ea1dd60a21cfe)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:31.247832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.256677 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:31.287719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a3f4-34fb-4b4f-9207-37d3bcb7a67e admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.302520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a14e4ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.303208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.303517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.303763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.304634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:31.309927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:31.329776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411d8378162d4e5f9d0ea1dd60a21cfe', 'request_id': 'req-b522b592-6264-4f9a-9727-949ccc759995'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:31.337642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 851/1704] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:31.340100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.348223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411d8378162d4e5f9d0ea1dd60a21cfe', 'request_id': 'req-b522b592-6264-4f9a-9727-949ccc759995'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:31.351977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f3a442-aaf2-4e0c-a2dc-0a4312a221e4 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.365357 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411d8378162d4e5f9d0ea1dd60a21cfe', 'request_id': 'req-b522b592-6264-4f9a-9727-949ccc759995'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:31.387249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] The token cache is being invalidate because project 411d8378162d4e5f9d0ea1dd60a21cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:31.387545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:31.388255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:31.394707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 854/1705] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:31 2022] DELETE /identity/v3/projects/411d8378162d4e5f9d0ea1dd60a21cfe => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:31.395816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.397311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:31.492820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d7ff8-026e-4344-8196-55cd4bdd0709 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a1f5fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.493758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7ff8-026e-4344-8196-55cd4bdd0709 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.494040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7ff8-026e-4344-8196-55cd4bdd0709 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.494315 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d7ff8-026e-4344-8196-55cd4bdd0709 admin admin] PATH_INFO: `/v3/projects/f2dc22054fb240f9bc1fc1f2ca6cd459/users/f1951065026c49749dcf263416c52b8c/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.508526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522b592-6264-4f9a-9727-949ccc759995 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.518381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] RBAC: auth_context: {'token': <TokenModel (audit_id=4Tj8VH1kS-aTLtudxyItSA, audit_chain_id=['4Tj8VH1kS-aTLtudxyItSA']) at 0x7fe8a1103430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f48f833629541c2bbc718c2372e1c1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.519212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.519498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.520313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.525591 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:31.530003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d7ff8-026e-4344-8196-55cd4bdd0709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2dc22054fb240f9bc1fc1f2ca6cd459, user_id=f1951065026c49749dcf263416c52b8c, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:31.533012 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d7ff8-026e-4344-8196-55cd4bdd0709 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:31.557637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 852/1706] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:31 2022] PUT /identity/v3/projects/f2dc22054fb240f9bc1fc1f2ca6cd459/users/f1951065026c49749dcf263416c52b8c/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:31.560170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cec1d-cf48-44b3-99f1-598727d62143 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.560612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cec1d-cf48-44b3-99f1-598727d62143 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.561186 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cec1d-cf48-44b3-99f1-598727d62143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.592934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-f19cec1d-cf48-44b3-99f1-598727d62143 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:31.594567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f19cec1d-cf48-44b3-99f1-598727d62143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:31.651770 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:31.655221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9dca7f-6ef2-4384-91d8-74e73c17d481 service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:31.669252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 855/1707] 10.222.0.49 () {60 vars in 1384 bytes} [Fri May 13 12:54:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 13 12:54:31.671458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.682332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.682638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.702252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 853/1708] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:31.704040 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.704479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.704902 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.761326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] MFA Rules not processed for user `f1951065026c49749dcf263416c52b8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:31.770656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:31.785750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:31.793808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:31.881802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 854/1709] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:31.888455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:31.936949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ab54e-1d1f-46e6-8c74-82c6b3cc07a0 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:31.982605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1022250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:31.983314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:31.983595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:31.984002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:31.984771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:31.985105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.000080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.055472 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 855/1710] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:32.060780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.104236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d0291-cfa0-43d4-82c1-840975b7ebef admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.146990 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1872fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:32.147842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:32.149323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:32.150015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:32.151530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.158942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.166910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 856/1711] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:32.172931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.178020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:32.223763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f773c-6bb2-4bc8-9790-2271d4b5bd0d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.237283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a17d3df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:32.238224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:32.238705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:32.239084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:32.240071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.242321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.265136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 856/1712] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:32 2022] POST /identity/v3/projects => generated 405 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:32.266107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.269940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:32.310775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 857/1713] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:32 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:32.310775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.463625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2133f5-b737-4bc8-ae0f-8b9a66f4220c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.472414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a14dc2b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:32.473349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:32.473739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:32.474175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:32.474937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.477254 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.491573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512250-105e-49e0-a47f-92b5d92ed654 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.515390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a151c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:32.516478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:32.516767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:32.519767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] PATH_INFO: `/v3/users/21205f7e5b4d497393e39930239c62cc` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:32.522235 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21205f7e5b4d497393e39930239c62cc)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.527576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.546446 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 858/1714] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:32 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:32.547753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.581881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bc761e-6ac6-4f06-b42c-ea32a1401db7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.604956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a100a4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:32.611908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:32.614769 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:32.615295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:32.616246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.621919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.691114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 859/1715] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:32 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:32.692504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.698245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21205f7e5b4d497393e39930239c62cc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:32.708880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21205f7e5b4d497393e39930239c62cc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:32.711018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21205f7e5b4d497393e39930239c62cc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:32.734712 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595ba41-97f9-48d8-a5f9-6d02d302bb90 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.742661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21205f7e5b4d497393e39930239c62cc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:32.753869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a109c580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:32.754658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:32.754956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:32.755246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:32.756292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:32.758291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21205f7e5b4d497393e39930239c62cc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:32.758513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:32.781569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 860/1716] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:32.783620 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.790909 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:32.804327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 857/1717] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:32 2022] DELETE /identity/v3/users/21205f7e5b4d497393e39930239c62cc => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:32.813516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:32.815867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8b72c-5db0-4550-b766-9be240bee63e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:32.816867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.001773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a1579880>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.003172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.003172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.003172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] PATH_INFO: `/v3/projects/739aea76b0ad43cabcf21da1340afc55` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.007055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=739aea76b0ad43cabcf21da1340afc55)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.009036 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.045333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99037b4-e727-4c6c-a9bf-34d529240aa4 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.063794 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a15cc8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.064805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.065291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.065712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.066614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.068428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.107966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 858/1718] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:33.124175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:33.127050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.160184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739aea76b0ad43cabcf21da1340afc55', 'request_id': 'req-e20a88d9-a30c-426c-99a4-15d383404a1d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.177659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127db807-5162-48e7-bf09-28c0976075bd admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.183194 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739aea76b0ad43cabcf21da1340afc55', 'request_id': 'req-e20a88d9-a30c-426c-99a4-15d383404a1d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.201593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739aea76b0ad43cabcf21da1340afc55', 'request_id': 'req-e20a88d9-a30c-426c-99a4-15d383404a1d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.235483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] The token cache is being invalidate because project 739aea76b0ad43cabcf21da1340afc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:33.235776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.237055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e20a88d9-a30c-426c-99a4-15d383404a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.246780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 861/1719] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:32 2022] DELETE /identity/v3/projects/739aea76b0ad43cabcf21da1340afc55 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:33.250722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.251014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.251292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.280432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1b851c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.281684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:33.281998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.283750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.284071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.284866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.285854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.291932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.313081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 862/1720] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:33.313081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:33.314797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.338151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 859/1721] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:33.339173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:33.340363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3969dd-b12c-4c86-a1eb-1f3739bba090 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.342032 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.360105 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a10a4d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.361046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.361330 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.361604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] PATH_INFO: `/v3/projects/1d64aacf30ac4be586f2ffc4c784498d/users/a45b281fa1b841ca94491100817ca5ec/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.367444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bcd8b-3969-4b89-97d9-764b5cb48ac6 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.380747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a1129d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.382024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.382607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.382977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] PATH_INFO: `/v3/users/8ced258df4454d659ea6800545fefa4f` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.385511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ced258df4454d659ea6800545fefa4f)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.391411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.409230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d64aacf30ac4be586f2ffc4c784498d, user_id=a45b281fa1b841ca94491100817ca5ec, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.415211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.451896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 863/1722] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:33 2022] PUT /identity/v3/projects/1d64aacf30ac4be586f2ffc4c784498d/users/a45b281fa1b841ca94491100817ca5ec/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:33.453026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:33.460452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.548889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ced258df4454d659ea6800545fefa4f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.550904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ced258df4454d659ea6800545fefa4f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.552436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ced258df4454d659ea6800545fefa4f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.594177 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac35832-8f8b-4ff7-8af2-987a1040d125 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.602178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a10a42b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.603111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.604392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.604392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] PATH_INFO: `/v3/projects/fb8568cfd3d44b33a25d1193a6c2de7b/users/9a6d3454ba9b4ae1a8d94a2edd1e5037/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.620372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ced258df4454d659ea6800545fefa4f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.645021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb8568cfd3d44b33a25d1193a6c2de7b, user_id=9a6d3454ba9b4ae1a8d94a2edd1e5037, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.647289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.655290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ced258df4454d659ea6800545fefa4f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:33.676296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 864/1723] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:33 2022] PUT /identity/v3/projects/fb8568cfd3d44b33a25d1193a6c2de7b/users/9a6d3454ba9b4ae1a8d94a2edd1e5037/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:33.677124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:33.682983 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.705977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 860/1724] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:33 2022] DELETE /identity/v3/users/8ced258df4454d659ea6800545fefa4f => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:33.708106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:33.711620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.813528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae345ca-cf16-41dd-8fbd-7947e6b7f96c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.901560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a134e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.902905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.903192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.903513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.906456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:33.948858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517107-e4cf-4ce4-b010-c6dba8cdae70 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:33.966286 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136e821-a01e-44a0-a06a-a1adb279be0c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a19a3610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:33.967159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e821-a01e-44a0-a06a-a1adb279be0c admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.967424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e821-a01e-44a0-a06a-a1adb279be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:33.967696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136e821-a01e-44a0-a06a-a1adb279be0c admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:33.968445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136e821-a01e-44a0-a06a-a1adb279be0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:33.974366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136e821-a01e-44a0-a06a-a1adb279be0c admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:33.997878 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 861/1725] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:33 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:33.999443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0534d4-c940-4dde-9c8a-fe57fadfd2d8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:33.999731 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0534d4-c940-4dde-9c8a-fe57fadfd2d8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:34.000011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0534d4-c940-4dde-9c8a-fe57fadfd2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:34.008903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:34.010958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:34.039695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5a0534d4-c940-4dde-9c8a-fe57fadfd2d8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:34.040939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5a0534d4-c940-4dde-9c8a-fe57fadfd2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:34.042838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 865/1726] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:34.044835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:34.082466 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16063e-cdf7-41e6-bcfa-96e4127abf90 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:34.087382 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 862/1727] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:34.109559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a187de20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:34.110760 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:34.110874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:34.111231 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] PATH_INFO: `/v3/projects/1d64aacf30ac4be586f2ffc4c784498d/users/a45b281fa1b841ca94491100817ca5ec/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:34.113208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d64aacf30ac4be586f2ffc4c784498d, user_id=a45b281fa1b841ca94491100817ca5ec, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:34.115868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:34.159274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 866/1728] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:34 2022] PUT /identity/v3/projects/1d64aacf30ac4be586f2ffc4c784498d/users/a45b281fa1b841ca94491100817ca5ec/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:34.169986 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:34.170277 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:34.170556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:34.244526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] MFA Rules not processed for user `a45b281fa1b841ca94491100817ca5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:34.246415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:34.287604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:34.297870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:34.493291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 863/1729] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:34.509923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:34.512495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:34.533574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e9fc3-dcfc-4dc3-a735-51c979983284 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:34.541470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1008e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:34.542268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:34.542648 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:34.542971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:34.725002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b8b56-098f-4893-8ef5-96997d2a2a66 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:34.743460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca541321-2986-4624-a496-aabda2407fa5 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a14e4a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:34.743460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541321-2986-4624-a496-aabda2407fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:34.743460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541321-2986-4624-a496-aabda2407fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:34.743460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca541321-2986-4624-a496-aabda2407fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:34.769340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca541321-2986-4624-a496-aabda2407fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:34.773721 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca541321-2986-4624-a496-aabda2407fa5 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:34.794958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:34.797237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:34.806970 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 864/1730] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:54:34.865043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 867/1731] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:35.109408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b37f-81ff-48ba-8a8c-0e252e402177 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:35.110155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b37f-81ff-48ba-8a8c-0e252e402177 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:35.110601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1b37f-81ff-48ba-8a8c-0e252e402177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:35.183966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-18c1b37f-81ff-48ba-8a8c-0e252e402177 None None] MFA Rules not processed for user `40efb0126116472aabce8459ff59bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:35.187437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-18c1b37f-81ff-48ba-8a8c-0e252e402177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:35.216619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 865/1732] 10.222.0.52 () {58 vars in 1015 bytes} [Fri May 13 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:35.322283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:35.329329 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29e1f7-9771-461c-8200-041135ed9acf service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:35.344199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a10082b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:35.344879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:35.345353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:35.345791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:35.358245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:35.359937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:35.376491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 868/1733] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:35.535396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:35.535837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:35.536237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:35.630749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] MFA Rules not processed for user `e9eb9ff59bef4adb83fbb4c5b358280a`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:35.635971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:35.795374 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:35.832798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25a6b4b-fb6e-462d-9836-d31d74c1d68f service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:35.870162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a0fd3b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:35.874058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:35.884946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:35.885954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] PATH_INFO: `/v3/users/f1951065026c49749dcf263416c52b8c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:35.900682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1951065026c49749dcf263416c52b8c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:35.910548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:36.017528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 866/1734] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:36.023844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:36.025560 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.083943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1951065026c49749dcf263416c52b8c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.084960 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1951065026c49749dcf263416c52b8c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.088213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1951065026c49749dcf263416c52b8c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.104408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1951065026c49749dcf263416c52b8c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.115894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-864ba0b3-9f7c-43ae-9bd8-7b1c2e33a180 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1951065026c49749dcf263416c52b8c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.159874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 869/1735] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:35 2022] DELETE /identity/v3/users/f1951065026c49749dcf263416c52b8c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:36.164848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:36.165398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:36.165827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:36.221806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:36.226411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.369799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 870/1736] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:36.370112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67ec66-70cc-474f-b76b-5db56f33c18e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:36.371115 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:36.372566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.385827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4adff2-540f-4373-a0af-11c5bd0e4d2f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:36.392101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a109c580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:36.393116 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:36.393453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:36.393768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] PATH_INFO: `/v3/projects/c548cd7de7ab49559612a700ff986ec7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:36.396223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c548cd7de7ab49559612a700ff986ec7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:36.398364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:36.458081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c548cd7de7ab49559612a700ff986ec7', 'request_id': 'req-b0d4726c-a176-4602-b547-d8e0186c90b9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.481205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c548cd7de7ab49559612a700ff986ec7', 'request_id': 'req-b0d4726c-a176-4602-b547-d8e0186c90b9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.497699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c548cd7de7ab49559612a700ff986ec7', 'request_id': 'req-b0d4726c-a176-4602-b547-d8e0186c90b9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.530052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] The token cache is being invalidate because project c548cd7de7ab49559612a700ff986ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:36.530828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.533044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.541427 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 871/1737] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:36 2022] DELETE /identity/v3/projects/c548cd7de7ab49559612a700ff986ec7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:36.543794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:36.550079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.588436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=4ienQcP1R_2SwULFfmkyyw, audit_chain_id=['4ienQcP1R_2SwULFfmkyyw']) at 0x7fe8a11e94c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:36.589148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:36.589523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:36.589819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:36.591753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.656816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4726c-a176-4602-b547-d8e0186c90b9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:36.662259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a10a23d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:36.663533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:36.664698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:36.665366 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:36.671450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.766207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:36.768099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:36.799023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:36.800950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:36.813946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 872/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:36.814221 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 867/1739] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 790 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:36.815103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:36.820340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.841665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8b08d-c0c9-43cc-9c06-9f4be3e9958e service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:36.853473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a14dcc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:36.857017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:36.857698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:36.858004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] PATH_INFO: `/v3/users/a2c2e812220d45558cb4fd1897c50218` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:36.863731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2c2e812220d45558cb4fd1897c50218)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:36.867314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:36.931133 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:36.932958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:36.964057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80196a52-bdd7-4e1c-9f06-f3d94cb7cf65 service nova] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:36.975371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=bnIjz3olQASI3YBa0yuq3g, audit_chain_id=['bnIjz3olQASI3YBa0yuq3g']) at 0x7fe8a160cfa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:36.976750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:36.977437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:36.981189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] PATH_INFO: `/v3/projects/8e542b961fb14cee841b0b584385d909` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:36.984899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e542b961fb14cee841b0b584385d909)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:36.990479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:36.990639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2c2e812220d45558cb4fd1897c50218'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.992285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2c2e812220d45558cb4fd1897c50218'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:36.993903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2c2e812220d45558cb4fd1897c50218'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.044336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2c2e812220d45558cb4fd1897c50218'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.064736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da50dd8b-c2a5-4315-9b27-1ea72c95626e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2c2e812220d45558cb4fd1897c50218'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.077502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e542b961fb14cee841b0b584385d909', 'request_id': 'req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.095859 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e542b961fb14cee841b0b584385d909', 'request_id': 'req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.111052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 873/1740] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:36 2022] DELETE /identity/v3/users/a2c2e812220d45558cb4fd1897c50218 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:37.115423 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e542b961fb14cee841b0b584385d909', 'request_id': 'req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.143614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] The token cache is being invalidate because project 8e542b961fb14cee841b0b584385d909 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:37.144548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.146273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7b3ea96d-1e9b-40f4-97b6-0a56ce24c007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:37.151095 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 868/1741] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:36 2022] DELETE /identity/v3/projects/8e542b961fb14cee841b0b584385d909 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:37.156128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:37.156426 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:37.156699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:37.191068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:37.192404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:37.347354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 874/1742] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:37.356360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:37.356688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:37.356929 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:37.424373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:37.443834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:37.483930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 869/1743] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:37.490689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:37.510992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ed5b2b-ff4b-4d9a-b24b-54e92b19bec8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:37.536027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a14c0190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:37.536889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:37.537018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:37.537314 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:37.538046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:37.538413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:37.540028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:37.599828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:37.601291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 875/1744] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:37.617513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3038a197-21ad-4ad2-94f3-c97e7aba4564 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:37.631835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a151cf10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:37.632532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:37.632820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:37.633130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:37.633851 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:37.638639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:37.728741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 870/1745] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:37 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:37.731157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:37.788391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb14eb-673e-4ae7-8038-c020f8497a40 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:37.915701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a0f52760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:37.917507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:37.918137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:37.918869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:37.921068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:37.924400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:37.972652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 876/1746] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:37 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:37.976659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:37.991344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464758d1-ab20-471b-a982-16df4f34d319 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:38.014291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a1022250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:38.015943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.016454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.017108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:38.018144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:38.020185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:38.058373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 871/1747] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:38.063158 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:38.082219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ccabd9-bd79-426b-ba03-66af45f8ba80 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:38.101086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db1d32-67ef-495b-b89e-402c43b01609 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a10a4d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:38.106904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db1d32-67ef-495b-b89e-402c43b01609 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.109248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db1d32-67ef-495b-b89e-402c43b01609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.109725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db1d32-67ef-495b-b89e-402c43b01609 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:38.111180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db1d32-67ef-495b-b89e-402c43b01609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:38.115043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db1d32-67ef-495b-b89e-402c43b01609 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:38.164350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 877/1748] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:38.166508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:38.180030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca511f0b-feba-4fef-bb36-0e09349bbfb7 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:38.197617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e1f3c-0806-4fee-b39d-180144573d87 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a183f3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:38.199399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1f3c-0806-4fee-b39d-180144573d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.202438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1f3c-0806-4fee-b39d-180144573d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.203522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e1f3c-0806-4fee-b39d-180144573d87 admin admin] PATH_INFO: `/v3/projects/f2b4242699ed486ba1c8bf475bebe810/users/884aaded9581419caaa212c75f3150c1/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:38.220084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5e56a-363f-460d-ab1b-2a0149269f63 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.220747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5e56a-363f-460d-ab1b-2a0149269f63 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.221279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5e56a-363f-460d-ab1b-2a0149269f63 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:38.223060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 878/1749] 10.222.0.49 () {54 vars in 921 bytes} [Fri May 13 12:54:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 13 12:54:38.259001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e1f3c-0806-4fee-b39d-180144573d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b4242699ed486ba1c8bf475bebe810, user_id=884aaded9581419caaa212c75f3150c1, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:38.262556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e1f3c-0806-4fee-b39d-180144573d87 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:38.305499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.305985 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.306346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:38.333112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 872/1750] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:38 2022] PUT /identity/v3/projects/f2b4242699ed486ba1c8bf475bebe810/users/884aaded9581419caaa212c75f3150c1/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:38.343010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b97c88-86da-44d1-af30-88d16328171f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.343357 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b97c88-86da-44d1-af30-88d16328171f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.343839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b97c88-86da-44d1-af30-88d16328171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:38.461964 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-75b97c88-86da-44d1-af30-88d16328171f None None] MFA Rules not processed for user `884aaded9581419caaa212c75f3150c1`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:38.463436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-75b97c88-86da-44d1-af30-88d16328171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:38.665611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:38.667129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:38.759220 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 873/1751] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:38.763664 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b97c88-86da-44d1-af30-88d16328171f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:38.853598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 879/1752] 10.222.0.49 () {58 vars in 1018 bytes} [Fri May 13 12:54:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 549 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:38.904157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:38.905962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:38.947038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98888f5a-3b54-4b73-9879-06ea63426ff7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:38.984409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=4ienQcP1R_2SwULFfmkyyw, audit_chain_id=['4ienQcP1R_2SwULFfmkyyw']) at 0x7fe8a181c730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:38.987147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:38.990189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:38.990584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:39.008256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b97c88-86da-44d1-af30-88d16328171f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:39.024026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:39.032110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:39.039799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a15cc8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:39.040489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:39.040771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:39.041172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:39.041955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:39.044698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:39.066016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 880/1753] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:39.121780 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 874/1754] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:38 2022] POST /identity/v3/projects => generated 385 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:39.125758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:39.146240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ca694-3bba-42e7-b38c-a82fff352407 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:39.354862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a17eef70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:39.357338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:39.358487 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:39.360005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:39.360821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:39.366180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:39.431100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 881/1755] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:39 2022] POST /identity/v3/users => generated 299 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:39.435607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:39.482121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9addfe9a-f6a2-4829-a974-0e03ea917092 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:39.498784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a11e9d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:39.499488 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:39.499857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:39.500218 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:39.501451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:39.503424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:39.537453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:39.540657 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:39.599723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84057b4f-6063-4d2a-b657-0dd4265a1a98 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:39.614832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 875/1756] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:39.617570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:39.626701 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=H27BjmA_TUmpw_YJTeLv1w, audit_chain_id=['H27BjmA_TUmpw_YJTeLv1w']) at 0x7fe8a17ee580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:39.630049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:39.631507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:39.632002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] PATH_INFO: `/v3/projects/22457a786ff84bfaaef6627af6f0aacb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:39.641172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=22457a786ff84bfaaef6627af6f0aacb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:39.646878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:39.653756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2933b2-bf0a-4c73-94ac-ca83ea194156 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:39.675122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a15f66d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:39.676602 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:39.677090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:39.677584 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] PATH_INFO: `/v3/projects/632023a6c4054b5f9322fa2616dd4045/users/187e369772c947faa8292ce293b01542/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:39.730228 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=632023a6c4054b5f9322fa2616dd4045, user_id=187e369772c947faa8292ce293b01542, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:39.740607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:39.790891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 876/1757] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:39 2022] PUT /identity/v3/projects/632023a6c4054b5f9322fa2616dd4045/users/187e369772c947faa8292ce293b01542/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:39.792253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:39.815353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22457a786ff84bfaaef6627af6f0aacb', 'request_id': 'req-f20983e4-747a-4520-b0a8-7c79be6d3ebc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:39.845223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22457a786ff84bfaaef6627af6f0aacb', 'request_id': 'req-f20983e4-747a-4520-b0a8-7c79be6d3ebc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:39.877233 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22457a786ff84bfaaef6627af6f0aacb', 'request_id': 'req-f20983e4-747a-4520-b0a8-7c79be6d3ebc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:39.924419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] The token cache is being invalidate because project 22457a786ff84bfaaef6627af6f0aacb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:39.925988 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:39.929344 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f20983e4-747a-4520-b0a8-7c79be6d3ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:39.934734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 882/1758] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:39 2022] DELETE /identity/v3/projects/22457a786ff84bfaaef6627af6f0aacb => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:39.946391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3fdcf-dbf0-45b7-a61c-9502e0f9911c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:39.946692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3fdcf-dbf0-45b7-a61c-9502e0f9911c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:39.946957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3fdcf-dbf0-45b7-a61c-9502e0f9911c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.030386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-dfd3fdcf-dbf0-45b7-a61c-9502e0f9911c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:40.032099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-dfd3fdcf-dbf0-45b7-a61c-9502e0f9911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:40.067704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c42c4-865a-4569-90b0-8fe1147a7fce admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:40.084842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a1190220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:40.085802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.086362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.086678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.087624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:40.093215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:40.127660 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 877/1759] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:40.133715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:40.136219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:40.188755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa345d5-71f6-49fa-a71d-bede338fc663 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:40.212769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bbed7-ee32-4fa5-af75-55c782bb25e8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a1a327c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:40.213727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bbed7-ee32-4fa5-af75-55c782bb25e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.214239 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bbed7-ee32-4fa5-af75-55c782bb25e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.215178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bbed7-ee32-4fa5-af75-55c782bb25e8 admin admin] PATH_INFO: `/v3/projects/632023a6c4054b5f9322fa2616dd4045/users/187e369772c947faa8292ce293b01542/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.222620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bbed7-ee32-4fa5-af75-55c782bb25e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632023a6c4054b5f9322fa2616dd4045, user_id=187e369772c947faa8292ce293b01542, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:40.226987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bbed7-ee32-4fa5-af75-55c782bb25e8 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:40.259575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 883/1760] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:40.261683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.264143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.264755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.278254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 878/1761] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:40 2022] PUT /identity/v3/projects/632023a6c4054b5f9322fa2616dd4045/users/187e369772c947faa8292ce293b01542/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:40.289960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.290160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.290573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.340213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:40.345713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:40.376514 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] MFA Rules not processed for user `187e369772c947faa8292ce293b01542`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:40.381166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:40.521263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 884/1762] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:40.546590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:40.572799 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b9d5-8e98-4f68-8c4f-5af91b28cd2c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:40.592934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 879/1763] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:40.615598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a1c61eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:40.616368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.621820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.622263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.623263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:40.623587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:40.628675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:40.628898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:40.630330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:40.682027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 885/1764] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:40.687224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:40.713689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95dc2b-a236-4e1c-8bbe-e341d0c481ff admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:40.730681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a0ff3580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:40.734541 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.735704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.735975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.741545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:40.751625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:40.775681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6f1f6f-44e3-453a-bc12-1fb37a5ecdc8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:40.787665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a15310d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:40.790377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:40.790926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:40.792777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:40.812015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:40.816697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:40.821607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 886/1765] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:40 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:40.825603 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:40.840268 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 880/1766] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:40 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:54:40.938603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:40.973279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de99390-ff0a-46d8-af0e-0573005bf889 service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:41.023467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcb98-49fa-42e2-99e1-7a0bbebed0af admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:41.044463 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a103adf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:41.047548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.048297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.049039 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.050604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:41.063798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:41.131658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 887/1767] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:40 2022] POST /identity/v3/users => generated 291 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:41.135353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:41.162793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6e72-c4b0-42fa-8996-9ac3cb47f23c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:41.174443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a1834130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:41.175271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.175599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.175968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.176808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:41.178616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:41.205634 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 888/1768] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:41.209405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:41.220368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a1531df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:41.221288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.221751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.222149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] PATH_INFO: `/v3/users/884aaded9581419caaa212c75f3150c1` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.223725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=884aaded9581419caaa212c75f3150c1)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:41.228096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:41.246183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7284b3a7-558d-43f8-9a9c-f56cf0000080 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:41.263079 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a10abdc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:41.264495 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.264784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.265090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.265857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:41.270258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:41.306639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 889/1769] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:41.310761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:41.356850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d81ffa2-d98e-46fe-9aca-084af568dad1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:41.362564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8bf484-0039-4e32-9b05-167892fa5f64 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a1b73610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:41.363396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf484-0039-4e32-9b05-167892fa5f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.363676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf484-0039-4e32-9b05-167892fa5f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.363951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8bf484-0039-4e32-9b05-167892fa5f64 admin admin] PATH_INFO: `/v3/projects/d3924b7468484ca18de786c2a833b256/users/3ed6b47429e049d0a2a0cc31784db1ea/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.369248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '884aaded9581419caaa212c75f3150c1'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:41.373811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '884aaded9581419caaa212c75f3150c1'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:41.374548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '884aaded9581419caaa212c75f3150c1'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:41.404196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '884aaded9581419caaa212c75f3150c1'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:41.418242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bf484-0039-4e32-9b05-167892fa5f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3924b7468484ca18de786c2a833b256, user_id=3ed6b47429e049d0a2a0cc31784db1ea, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:41.420836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-18018525-ee8e-411e-a968-d2b0a4798fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '884aaded9581419caaa212c75f3150c1'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:41.421055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8bf484-0039-4e32-9b05-167892fa5f64 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:41.462104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 890/1770] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:41 2022] PUT /identity/v3/projects/d3924b7468484ca18de786c2a833b256/users/3ed6b47429e049d0a2a0cc31784db1ea/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:41.464138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.464464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.464869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.471534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 881/1771] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:40 2022] DELETE /identity/v3/users/884aaded9581419caaa212c75f3150c1 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:41.474867 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48486ae-ebcf-448b-8ca8-a52fa7f92078 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.475285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48486ae-ebcf-448b-8ca8-a52fa7f92078 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.477417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48486ae-ebcf-448b-8ca8-a52fa7f92078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.534227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e48486ae-ebcf-448b-8ca8-a52fa7f92078 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:41.546410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e48486ae-ebcf-448b-8ca8-a52fa7f92078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:41.559130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] MFA Rules not processed for user `3ed6b47429e049d0a2a0cc31784db1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:41.561708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:41.735858 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 882/1772] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:41.740373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.740669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.740952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.741576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 891/1773] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:41.748465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:41.753768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:41.801217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b069d8-fc07-4b51-a15d-48e10041f8de None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:41.815340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a17e8700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:41.816030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:41.816313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:41.816631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:41.817193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] MFA Rules not processed for user `9a6d3454ba9b4ae1a8d94a2edd1e5037`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:41.817449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:41.819828 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:41.821409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:41.883216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 892/1774] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:41 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:41.884286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:41.890576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:42.069375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90b655-633c-473d-bec0-db4f30d3deba admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:42.074151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1058700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:42.074810 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:42.075093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:42.075368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:42.097994 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 883/1775] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:42.100401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:42.139328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5e51e-bdf5-4352-97db-1ead5708995c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:42.236604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:42.238340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:42.268665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 893/1776] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:42.269554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:42.279958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:42.305353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42280ad-6e10-43dc-a15d-2d2b54cc8293 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:42.317736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a18455e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:42.318476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:42.318776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:42.319052 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:42.320946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:42.327099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:42.360885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a1872fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:42.361893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:42.361893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:42.362196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:42.362860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:42.364817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:42.395874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 894/1777] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:42 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:42.396604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:42.398384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:42.438783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 884/1778] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:42 2022] POST /identity/v3/users => generated 297 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:42.439836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:42.476823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82a9190-519c-4bb9-ad60-492bdad04d35 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:42.554006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ec2d4-576e-4156-b5ae-de865c2ddedc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:42.569974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a1838eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:42.574326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:42.574326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:42.574326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] PATH_INFO: `/v3/projects/f2dc22054fb240f9bc1fc1f2ca6cd459` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:42.582386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2dc22054fb240f9bc1fc1f2ca6cd459)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:42.588665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:42.690714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1019c10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:42.691685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:42.692019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:42.692368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:42.693112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:42.704142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:42.744548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2dc22054fb240f9bc1fc1f2ca6cd459', 'request_id': 'req-8c675a65-2605-4922-b37f-5669abe97373'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:42.758543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 885/1779] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:42 2022] POST /identity/v3/users => generated 308 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:42.764146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2dc22054fb240f9bc1fc1f2ca6cd459', 'request_id': 'req-8c675a65-2605-4922-b37f-5669abe97373'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:42.779802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:42.795709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2dc22054fb240f9bc1fc1f2ca6cd459', 'request_id': 'req-8c675a65-2605-4922-b37f-5669abe97373'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:42.820819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] The token cache is being invalidate because project f2dc22054fb240f9bc1fc1f2ca6cd459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:42.820819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:42.821121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7969d2-8aba-41c0-a403-1645edc7ac23 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:42.821428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:42.832887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 895/1780] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:42 2022] DELETE /identity/v3/projects/f2dc22054fb240f9bc1fc1f2ca6cd459 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:42.832887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:42.832887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:42.977644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c675a65-2605-4922-b37f-5669abe97373 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.005980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1811580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.006665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.006951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.007218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.008397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.010597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.025226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a120be50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.026490 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.027144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.028174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.030358 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.034022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.068273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 896/1781] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:43.069370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.072003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 886/1782] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:43.072003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.079114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:43.110752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a13bf-c130-4e81-8c9b-8762ca01205a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.113774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9771ad2b-0e67-4466-a591-488decd58276 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.116069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a1a18d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.117319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.117465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.117623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] PATH_INFO: `/v3/users/a45b281fa1b841ca94491100817ca5ec` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.124699 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a160adc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.125656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.125775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a45b281fa1b841ca94491100817ca5ec)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.125960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.126633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] PATH_INFO: `/v3/projects/a0db6422bb06431783f18846e0768ef9/users/be9599dbb9b6428bb96268da39799fae/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.127656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.195428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0db6422bb06431783f18846e0768ef9, user_id=be9599dbb9b6428bb96268da39799fae, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.207201 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.229334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a45b281fa1b841ca94491100817ca5ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:43.231006 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a45b281fa1b841ca94491100817ca5ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:43.232832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a45b281fa1b841ca94491100817ca5ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:43.253501 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 887/1783] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:43 2022] PUT /identity/v3/projects/a0db6422bb06431783f18846e0768ef9/users/be9599dbb9b6428bb96268da39799fae/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:43.255142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.260347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a45b281fa1b841ca94491100817ca5ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:43.261108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:43.280365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a45b281fa1b841ca94491100817ca5ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:43.308149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 897/1784] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:43 2022] DELETE /identity/v3/users/a45b281fa1b841ca94491100817ca5ec => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:43.310587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.312803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:43.436013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa159392-baa7-4b3b-a44a-315b327fff14 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.443450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7045e-3e02-4699-a698-92d2b8092d53 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.450210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a15315b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.451445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.451882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.452352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] PATH_INFO: `/v3/projects/c91ba225781d4a4881f5e70aecb23452/users/c59ded86a9924cf19433fe2adb3cea6e/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.452938 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a17d6220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.453705 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.454056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.454368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.455315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.457316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.479436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 898/1785] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:43.492635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.507111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd673f37-b9e5-4671-8230-ec78f48b962f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.508100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91ba225781d4a4881f5e70aecb23452, user_id=c59ded86a9924cf19433fe2adb3cea6e, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.512898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.516704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a183c730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.536316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.537380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.537534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 888/1786] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:43 2022] PUT /identity/v3/projects/c91ba225781d4a4881f5e70aecb23452/users/c59ded86a9924cf19433fe2adb3cea6e/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:43.537621 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] PATH_INFO: `/v3/projects/a0db6422bb06431783f18846e0768ef9/users/be9599dbb9b6428bb96268da39799fae/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.541156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.544423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0db6422bb06431783f18846e0768ef9, user_id=be9599dbb9b6428bb96268da39799fae, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.551457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.578112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 899/1787] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:43 2022] PUT /identity/v3/projects/a0db6422bb06431783f18846e0768ef9/users/be9599dbb9b6428bb96268da39799fae/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:43.656088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141cba22-fe50-474b-b31f-48438ed7efd3 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.705785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.711728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:43.794257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a14a7cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.795998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.796741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.797399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.798618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.800863 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.833728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 889/1788] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:43.835686 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:43.847656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83909172-c2a1-4695-9831-2ecf74407ef2 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:43.873999 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a4e48-b50e-48a3-b8e9-09ef48d13ab5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a1143850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:43.877603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4e48-b50e-48a3-b8e9-09ef48d13ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.878024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4e48-b50e-48a3-b8e9-09ef48d13ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.878313 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a4e48-b50e-48a3-b8e9-09ef48d13ab5 admin admin] PATH_INFO: `/v3/projects/c91ba225781d4a4881f5e70aecb23452/users/c59ded86a9924cf19433fe2adb3cea6e/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.882413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a4e48-b50e-48a3-b8e9-09ef48d13ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c91ba225781d4a4881f5e70aecb23452, user_id=c59ded86a9924cf19433fe2adb3cea6e, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:43.888008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a4e48-b50e-48a3-b8e9-09ef48d13ab5 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:43.918736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 890/1789] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:43 2022] PUT /identity/v3/projects/c91ba225781d4a4881f5e70aecb23452/users/c59ded86a9924cf19433fe2adb3cea6e/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:43.929827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:43.930128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:43.931046 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:43.999123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc9a1b-d2f4-42c9-bac7-b9bef1b36a3c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:44.006676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] MFA Rules not processed for user `c59ded86a9924cf19433fe2adb3cea6e`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:44.007884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:44.179125 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a13bfb80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:44.182359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:44.182641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:44.182922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] PATH_INFO: `/v3/projects/f2b4242699ed486ba1c8bf475bebe810` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:44.186983 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b4242699ed486ba1c8bf475bebe810)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:44.188941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:44.238855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 891/1790] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:44.270173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:44.273476 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:44.379393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b4242699ed486ba1c8bf475bebe810', 'request_id': 'req-c616d0d2-60e3-4478-834f-48c658d729ff'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.397685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b4242699ed486ba1c8bf475bebe810', 'request_id': 'req-c616d0d2-60e3-4478-834f-48c658d729ff'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.411725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc0879-5c80-4408-b7d0-ff5dc35b7655 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:44.421823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b4242699ed486ba1c8bf475bebe810', 'request_id': 'req-c616d0d2-60e3-4478-834f-48c658d729ff'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.466196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] The token cache is being invalidate because project f2b4242699ed486ba1c8bf475bebe810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:44.466558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.469438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.477134 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 900/1791] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:43 2022] DELETE /identity/v3/projects/f2b4242699ed486ba1c8bf475bebe810 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:44.481679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:44.483183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:44.631328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a10a2a60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:44.634248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:44.634546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:44.634829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:44.637644 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:44.691451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616d0d2-60e3-4478-834f-48c658d729ff admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:44.708524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a18c5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:44.711089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:44.711383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:44.711674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] PATH_INFO: `/v3/users/187e369772c947faa8292ce293b01542` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:44.719071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] RBAC: Authorizing `identity:delete_user(user_id=187e369772c947faa8292ce293b01542)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:44.722017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:44.811960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:44.816482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46331cc-1e6d-4cb0-891e-80bae66b16d7 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:44.852181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 892/1792] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:44 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:44.869422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '187e369772c947faa8292ce293b01542'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.870124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '187e369772c947faa8292ce293b01542'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.875457 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '187e369772c947faa8292ce293b01542'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.885275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:44.886350 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:44.887504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:44.951680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '187e369772c947faa8292ce293b01542'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:44.952776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] MFA Rules not processed for user `b8c8941361fb4800ad0574237c9ac377`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:44.955752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:44.990957 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '187e369772c947faa8292ce293b01542'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:45.033501 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 901/1793] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:44 2022] DELETE /identity/v3/users/187e369772c947faa8292ce293b01542 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:45.196143 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 893/1794] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:45.204805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:45.206684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:45.457869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4694ff4-bd9a-4934-805b-a691bb91047c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:45.479152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=4ienQcP1R_2SwULFfmkyyw, audit_chain_id=['4ienQcP1R_2SwULFfmkyyw']) at 0x7fe8a17eb310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:45.481737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:45.483167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:45.486619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:45.779778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:45.789328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:45.842423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 902/1795] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 636 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:45.889581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:45.891142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:45.942256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95734a60-6d3e-4433-ae43-893f95d15c78 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:46.257885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7Sw1QQ-fQFGwm_hP2yZB6g, audit_chain_id=['7Sw1QQ-fQFGwm_hP2yZB6g']) at 0x7fe8a14cba60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c59ded86a9924cf19433fe2adb3cea6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba225781d4a4881f5e70aecb23452', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:46.258681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:46.258965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:46.259242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:46.267784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:46.268330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:46.272919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa780d-cad2-44de-adbc-b97970c9fc1a tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:46.307768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 894/1796] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:46.311934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:46.335608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e711c7-bd7b-4fdc-b8d5-ba9cc1159799 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:46.382268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7Sw1QQ-fQFGwm_hP2yZB6g, audit_chain_id=['7Sw1QQ-fQFGwm_hP2yZB6g']) at 0x7fe8a1058700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c59ded86a9924cf19433fe2adb3cea6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba225781d4a4881f5e70aecb23452', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:46.385846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:46.390454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:46.390897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:46.391735 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:46.406317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:46.414934 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:46.415209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:46.415486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:46.440337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] MFA Rules not processed for user `e9eb9ff59bef4adb83fbb4c5b358280a`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:46.442947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:46.526679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 903/1797] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:46 2022] POST /identity/v3/projects => generated 353 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:46.532106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:46.656172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 895/1798] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:46.735032 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407709d0-ae19-4ea7-b17b-05e7778d31d3 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:46.747308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7Sw1QQ-fQFGwm_hP2yZB6g, audit_chain_id=['7Sw1QQ-fQFGwm_hP2yZB6g']) at 0x7fe8a1457640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c59ded86a9924cf19433fe2adb3cea6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba225781d4a4881f5e70aecb23452', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:46.751282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:46.751282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:46.751282 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:46.752296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:46.753540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:46.757739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:46.795443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 904/1799] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:46.873569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:46.918655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc743c-4571-4d66-8e71-bcee0adaccc4 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:46.942210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7Sw1QQ-fQFGwm_hP2yZB6g, audit_chain_id=['7Sw1QQ-fQFGwm_hP2yZB6g']) at 0x7fe8a1019370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c59ded86a9924cf19433fe2adb3cea6e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c91ba225781d4a4881f5e70aecb23452', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:46.943713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:46.944235 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:46.944736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] PATH_INFO: `/v3/projects/34ee03ce001b4edc91daed72b134e40e` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:46.947101 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorizing `identity:delete_project(project_id=34ee03ce001b4edc91daed72b134e40e)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:46.957096 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:47.015398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:47.017380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:47.056796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ee03ce001b4edc91daed72b134e40e', 'request_id': 'req-9f24e18f-7ea4-46c5-b250-a893c7f563ac'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.072187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ee03ce001b4edc91daed72b134e40e', 'request_id': 'req-9f24e18f-7ea4-46c5-b250-a893c7f563ac'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.085716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ee03ce001b4edc91daed72b134e40e', 'request_id': 'req-9f24e18f-7ea4-46c5-b250-a893c7f563ac'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.118162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] The token cache is being invalidate because project 34ee03ce001b4edc91daed72b134e40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:47.118459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.119376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9f24e18f-7ea4-46c5-b250-a893c7f563ac tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.122806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 896/1800] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:46 2022] DELETE /identity/v3/projects/34ee03ce001b4edc91daed72b134e40e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:47.129630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:47.130093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:47.130549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:47.226246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c250a5-83a6-4f36-a2e4-11c5410089b2 tempest-VolumeQuotaClassesTest-2105823755 tempest-VolumeQuotaClassesTest-2105823755-project-admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:47.258138 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] MFA Rules not processed for user `fbad87a0396f4deb92f4da676af8bfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:47.260048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:47.397324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=0zUYcqruQgGZLaQsdooc8g, audit_chain_id=['0zUYcqruQgGZLaQsdooc8g']) at 0x7fe8a187d0a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:47.399455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:47.401766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:47.402332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] PATH_INFO: `/v3/projects/1d64aacf30ac4be586f2ffc4c784498d` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:47.405470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d64aacf30ac4be586f2ffc4c784498d)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:47.409667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:47.461672 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 897/1801] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:47.462854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:47.467069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:47.524329 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1978fd-4766-41d6-a3bf-f6344d95ae48 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:47.536423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d64aacf30ac4be586f2ffc4c784498d', 'request_id': 'req-21853b2b-884d-4102-b51a-ae53ffdcf5aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.550381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d64aacf30ac4be586f2ffc4c784498d', 'request_id': 'req-21853b2b-884d-4102-b51a-ae53ffdcf5aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.567114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d64aacf30ac4be586f2ffc4c784498d', 'request_id': 'req-21853b2b-884d-4102-b51a-ae53ffdcf5aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.601680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] The token cache is being invalidate because project 1d64aacf30ac4be586f2ffc4c784498d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:47.602354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.606729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-21853b2b-884d-4102-b51a-ae53ffdcf5aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.611139 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 905/1802] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:47 2022] DELETE /identity/v3/projects/1d64aacf30ac4be586f2ffc4c784498d => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:47.613181 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8e72-f3a6-47c7-b8ec-f8c59cff3c6b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:47.616377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8e72-f3a6-47c7-b8ec-f8c59cff3c6b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:47.616377 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ce8e72-f3a6-47c7-b8ec-f8c59cff3c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:47.661172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f3ce8e72-f3a6-47c7-b8ec-f8c59cff3c6b None None] MFA Rules not processed for user `fbad87a0396f4deb92f4da676af8bfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:47.663977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f3ce8e72-f3a6-47c7-b8ec-f8c59cff3c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:47.715650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=b7hPaBr3TAikjSLusjs7XQ, audit_chain_id=['b7hPaBr3TAikjSLusjs7XQ']) at 0x7fe8a183fd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:47.716597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:47.718762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:47.719090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] PATH_INFO: `/v3/projects/632023a6c4054b5f9322fa2616dd4045` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:47.723951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632023a6c4054b5f9322fa2616dd4045)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:47.729581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:47.870328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 906/1803] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:47.875321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:47.875535 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:47.877171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:47.883967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632023a6c4054b5f9322fa2616dd4045', 'request_id': 'req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.916273 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632023a6c4054b5f9322fa2616dd4045', 'request_id': 'req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.927441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632023a6c4054b5f9322fa2616dd4045', 'request_id': 'req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.944071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] The token cache is being invalidate because project 632023a6c4054b5f9322fa2616dd4045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:47.944554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.947965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-3bfc527e-1208-4e25-b8b7-1dd20c2594a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:47.950916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 898/1804] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:47 2022] DELETE /identity/v3/projects/632023a6c4054b5f9322fa2616dd4045 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:47.952443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77e4d6-ff51-49fe-95e9-9c574cd16970 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:47.952830 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77e4d6-ff51-49fe-95e9-9c574cd16970 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:47.954030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77e4d6-ff51-49fe-95e9-9c574cd16970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:47.958270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] MFA Rules not processed for user `be9599dbb9b6428bb96268da39799fae`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:47.961107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.003418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1d77e4d6-ff51-49fe-95e9-9c574cd16970 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:48.007049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1d77e4d6-ff51-49fe-95e9-9c574cd16970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.127559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 907/1805] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:48.131857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.134540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.151477 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 899/1806] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:48.153245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c1a73-c17e-4d65-a2e6-ce989eb4a3b3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.154804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c1a73-c17e-4d65-a2e6-ce989eb4a3b3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.155251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c1a73-c17e-4d65-a2e6-ce989eb4a3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.161493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c319e0-a7fb-4719-a52a-1a634f1dbebb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:48.178266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a25a5310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:48.179261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.179647 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.180025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] PATH_INFO: `/v3/users/3ed6b47429e049d0a2a0cc31784db1ea` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.181714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed6b47429e049d0a2a0cc31784db1ea)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:48.184550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:48.194270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4d6c1a73-c17e-4d65-a2e6-ce989eb4a3b3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:48.198718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4d6c1a73-c17e-4d65-a2e6-ce989eb4a3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.220747 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 900/1807] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:48.222763 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d88f-02bd-475f-b094-b4949d4f75e3 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.224684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d88f-02bd-475f-b094-b4949d4f75e3 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.226898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5550d88f-02bd-475f-b094-b4949d4f75e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.270538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5550d88f-02bd-475f-b094-b4949d4f75e3 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:48.272447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5550d88f-02bd-475f-b094-b4949d4f75e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.303961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed6b47429e049d0a2a0cc31784db1ea'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:48.306061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed6b47429e049d0a2a0cc31784db1ea'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:48.306935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 901/1808] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:48.309603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.310406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed6b47429e049d0a2a0cc31784db1ea'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:48.312424 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.314604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.348476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed6b47429e049d0a2a0cc31784db1ea'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:48.374222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed6b47429e049d0a2a0cc31784db1ea'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:48.379839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:48.385454 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.409052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 902/1809] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:48.410072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.412581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 908/1810] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:48 2022] DELETE /identity/v3/users/3ed6b47429e049d0a2a0cc31784db1ea => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:48.413504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.419184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.421481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.449922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e70e-c78f-4740-813b-d08b49ff1de4 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:48.611578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce3aa-af24-488f-b477-17f9bf189514 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:48.665793 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=4ienQcP1R_2SwULFfmkyyw, audit_chain_id=['4ienQcP1R_2SwULFfmkyyw']) at 0x7fe8a1895190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:48.666925 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.667533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.668869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.672285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1561d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:48.673305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.673986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.674082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.674082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.674739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:48.677117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:48.688260 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:48.718557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 903/1811] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:48.720028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.733266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79baff-7321-4a5d-8251-cd411a8ba50c admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:48.740146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a14e4ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:48.741211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.741655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.742083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.742987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:48.743451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:48.745446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573ceb09-cc9d-428b-bbe2-1c96fae2f720 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:48.762955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 904/1812] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:48.764746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.765234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.765935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.791205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:48.793831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.803480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 905/1813] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:48.804849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.839149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17a9bc-2396-461d-9e6d-89c3e3a69fe4 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:48.857420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a19b5160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:48.858183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:48.858583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:48.859384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:48.860565 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:48.862834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:48.868262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:48.869919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:48.892048 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 909/1814] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:48.897053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.916602 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 906/1815] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:48 2022] POST /identity/v3/projects => generated 369 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:48.919569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:48.922144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:48.926112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445e462-99cb-4d8e-9039-5ba3ee3546b4 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.065917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0ff35-4a78-4b59-9af4-313a5a412b28 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.069266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a17907f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.072334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.072624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.072869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.073146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a15f6850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.073601 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.075191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.075967 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.076400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.080117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.091322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.093027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.108402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 907/1816] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:49.110306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.128047 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27922aa-1786-4ce3-945d-adf4fe34986b service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.137630 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1575c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.138378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.138774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.139154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.139880 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.141720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 910/1817] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:48 2022] POST /identity/v3/projects => generated 409 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:49.146033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.156322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.215337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 908/1818] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:49 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:49.222330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.239804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd5caf-db5b-49a6-8c71-caeecb5e5ded admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.314051 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57172e-9d3a-44ad-ae03-0133b8979579 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.325419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a182b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.327672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.327961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.328622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.330792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.332905 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.350568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1561d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.351252 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.351532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.351818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.352538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.354330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.369217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 909/1819] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:49.379785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 911/1820] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:49 2022] POST /identity/v3/users => generated 305 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:54:49.381028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.384361 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.427663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131b4e9-5804-42a7-be66-daaccd2862cd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.428753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c76350-dbfe-4b66-970a-bf00e64991f3 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.439868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a182e940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.442211 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.442411 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1575c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.443165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.443812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.447663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.448185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.449752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.450155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.451004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.453429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.454631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.481119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 912/1821] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:54:49.482123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.482786 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 910/1822] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:49.484845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.506229 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04287f98-0e26-4d9e-9f37-8f95f6c4c414 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.515730 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd57a5-8953-418e-9546-6a4ddfa140c7 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.525940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a1056220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.526807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31359700-e90c-49a9-97ac-864caaeb1486 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a19e3fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.528375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.528937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31359700-e90c-49a9-97ac-864caaeb1486 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.529327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.529705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31359700-e90c-49a9-97ac-864caaeb1486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.530078 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.530912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31359700-e90c-49a9-97ac-864caaeb1486 admin admin] PATH_INFO: `/v3/projects/b2906b037ae3483c9380e399e95088c7/users/c07748e643cc49818b91b0599236d242/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.531962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.534280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.567618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 913/1823] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:49.568611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:49.574574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31359700-e90c-49a9-97ac-864caaeb1486 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2906b037ae3483c9380e399e95088c7, user_id=c07748e643cc49818b91b0599236d242, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.577338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31359700-e90c-49a9-97ac-864caaeb1486 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.588184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1596b-5844-415a-892a-347ba379dcd5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:49.594588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77190594-bdfb-48e3-a5c8-11dbcb555217 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a13b7640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:49.595486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190594-bdfb-48e3-a5c8-11dbcb555217 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.595815 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190594-bdfb-48e3-a5c8-11dbcb555217 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.596088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77190594-bdfb-48e3-a5c8-11dbcb555217 admin admin] PATH_INFO: `/v3/projects/877f12f680e44a2c9f48482d2e957675/users/482ec568f9f748beb145e3de076748a4/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.611439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 911/1824] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:49 2022] PUT /identity/v3/projects/b2906b037ae3483c9380e399e95088c7/users/c07748e643cc49818b91b0599236d242/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:49.614512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77190594-bdfb-48e3-a5c8-11dbcb555217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=877f12f680e44a2c9f48482d2e957675, user_id=482ec568f9f748beb145e3de076748a4, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:49.617373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77190594-bdfb-48e3-a5c8-11dbcb555217 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:49.622633 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.622907 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.623104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.655744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 914/1825] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:49 2022] PUT /identity/v3/projects/877f12f680e44a2c9f48482d2e957675/users/482ec568f9f748beb145e3de076748a4/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:49.667378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:49.667378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:49.669908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:49.710834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] MFA Rules not processed for user `c07748e643cc49818b91b0599236d242`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:49.715719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:49.743728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] MFA Rules not processed for user `482ec568f9f748beb145e3de076748a4`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:49.745069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:49.916963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 912/1826] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:49 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:49.922519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.014518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 915/1827] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:49 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:50.019223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.101897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdcbb2-49b2-45b5-8b26-a9c3dc8e3c8e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.116285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a160cfd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.126347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.127125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.127562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.129145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.132416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.137949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b28078-406b-42cb-ab3a-c36b3edb0d19 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.145089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a17902b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.147351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.147351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.147658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.148870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.152395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.217213 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 913/1828] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:49 2022] POST /identity/v3/projects => generated 369 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:50.222166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.229724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 916/1829] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:50 2022] POST /identity/v3/projects => generated 407 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:50.235666 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.395589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8255-aefd-4834-9bcf-c33a5bf365a8 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.404096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20ed53-59eb-422d-9587-7d2221f49db0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.413715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a15dfc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.416573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.417314 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.418360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.419574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a18aa280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.420577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.420724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.421027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.421951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.422462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.428113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.429512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.477195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 917/1830] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:50 2022] POST /identity/v3/users => generated 310 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:50.481949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.490689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 914/1831] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:50 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:50.499162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.509311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37d2c7-28e6-442c-99b6-6beb88568ac0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.521230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a0ffba00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.533343 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.534647 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.534997 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.536961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.541216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.543263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4f7ee-c2ee-4b72-b83b-5489c97dbc96 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.580519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 918/1832] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:50.580519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.596696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a15281c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.596696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.596696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.596696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.599163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.610364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e7fa-9187-468d-bf7d-1e5c7f3e8f0f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.618012 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.629073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a1429730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.630339 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.630789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.631240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] PATH_INFO: `/v3/projects/6124bc5aa7ab4099b052f88859b7436b/users/c59dbe3ceec8403e8c42ad18f4919b8d/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.707298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 915/1833] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:50.710750 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.717767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6124bc5aa7ab4099b052f88859b7436b, user_id=c59dbe3ceec8403e8c42ad18f4919b8d, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.729838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.737512 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d2299-fb05-4954-b7d9-f0597c06876b admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.747231 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1991e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.748795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.749154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.749428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] PATH_INFO: `/v3/projects/42b8335cfd42431b89a83fcf03789a4a/users/684919e3a62a4cc38e3524049eb21d0d/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.769878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 919/1834] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:50 2022] PUT /identity/v3/projects/6124bc5aa7ab4099b052f88859b7436b/users/c59dbe3ceec8403e8c42ad18f4919b8d/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:50.774405 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.776722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b8335cfd42431b89a83fcf03789a4a, user_id=684919e3a62a4cc38e3524049eb21d0d, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.783077 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.810598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 916/1835] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:50 2022] PUT /identity/v3/projects/42b8335cfd42431b89a83fcf03789a4a/users/684919e3a62a4cc38e3524049eb21d0d/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:50.811835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.890436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f23c10-b279-4289-b3a7-7531775fb285 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.896202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a131faf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.897223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.897607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.897982 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.898825 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.901323 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.904393 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a1dcb7-d245-4c66-b647-f97ec51a1857 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.913802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 920/1836] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:54:50.918349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.930927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c16edd-e525-494b-9bd5-f6abc8e71412 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:50.932542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1a0e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.933418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.933670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.933948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.935008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.938498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e6cf2-884b-4c1c-921d-52017ca854a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a1822340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:50.939579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e6cf2-884b-4c1c-921d-52017ca854a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.939976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e6cf2-884b-4c1c-921d-52017ca854a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.940347 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e6cf2-884b-4c1c-921d-52017ca854a5 admin admin] PATH_INFO: `/v3/projects/6124bc5aa7ab4099b052f88859b7436b/users/c59dbe3ceec8403e8c42ad18f4919b8d/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:50.942613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e6cf2-884b-4c1c-921d-52017ca854a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6124bc5aa7ab4099b052f88859b7436b, user_id=c59dbe3ceec8403e8c42ad18f4919b8d, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:50.943823 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.954225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e6cf2-884b-4c1c-921d-52017ca854a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:50.967893 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 917/1837] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:50 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:50.968865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:50.971722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 921/1838] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:50 2022] PUT /identity/v3/projects/6124bc5aa7ab4099b052f88859b7436b/users/c59dbe3ceec8403e8c42ad18f4919b8d/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:50.997283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8b0b-d4b0-4f01-9a3d-fe57066a87b5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:50.997604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8b0b-d4b0-4f01-9a3d-fe57066a87b5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:50.997940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f8b0b-d4b0-4f01-9a3d-fe57066a87b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:51.002528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687455a-c568-4578-a01f-7e7feb169dba admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:51.049619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9d3f8b0b-d4b0-4f01-9a3d-fe57066a87b5 None None] MFA Rules not processed for user `c59dbe3ceec8403e8c42ad18f4919b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:51.051216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9d3f8b0b-d4b0-4f01-9a3d-fe57066a87b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:51.191899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1575c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:51.193635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:51.194160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:51.194838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] PATH_INFO: `/v3/projects/42b8335cfd42431b89a83fcf03789a4a/users/684919e3a62a4cc38e3524049eb21d0d/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:51.198130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42b8335cfd42431b89a83fcf03789a4a, user_id=684919e3a62a4cc38e3524049eb21d0d, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:51.202305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:51.218876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 918/1839] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:50 2022] PUT /identity/v3/projects/42b8335cfd42431b89a83fcf03789a4a/users/684919e3a62a4cc38e3524049eb21d0d/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:51.220846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:51.223197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:51.310300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 922/1840] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:50 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:51.315056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:51.315695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:51.315695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:51.396808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] MFA Rules not processed for user `684919e3a62a4cc38e3524049eb21d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:51.403338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:51.404627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f621d-ba95-4a3d-8cbf-5aa32b24e023 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:51.411597 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a11d0310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:51.412701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:51.413118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:51.414369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] PATH_INFO: `/v3/projects/d3924b7468484ca18de786c2a833b256` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:51.415827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3924b7468484ca18de786c2a833b256)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:51.418679 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:51.494352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3924b7468484ca18de786c2a833b256', 'request_id': 'req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.504508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3924b7468484ca18de786c2a833b256', 'request_id': 'req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.539627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3924b7468484ca18de786c2a833b256', 'request_id': 'req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.572918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] The token cache is being invalidate because project d3924b7468484ca18de786c2a833b256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:51.573913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.624348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 923/1841] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:51 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:51.625019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:51.633815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.639082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 919/1842] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:51 2022] DELETE /identity/v3/projects/d3924b7468484ca18de786c2a833b256 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:51.641824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:51.644328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:51.646661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:51.815491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503d1ec-16e5-4a8b-89b5-4d7ea9e838d6 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:51.825931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a158df70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:51.828113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:51.828473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:51.828758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ded2d-3130-4510-a1aa-2ba7e4882fe6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:51.829139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] PATH_INFO: `/v3/users/c59ded86a9924cf19433fe2adb3cea6e` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:51.831020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59ded86a9924cf19433fe2adb3cea6e)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:51.833584 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:51.969896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a17eb310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:51.970489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:51.972049 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:51.972356 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:51.978851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:51.988865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59ded86a9924cf19433fe2adb3cea6e'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.991981 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59ded86a9924cf19433fe2adb3cea6e'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:51.993537 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59ded86a9924cf19433fe2adb3cea6e'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:52.021590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59ded86a9924cf19433fe2adb3cea6e'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:52.037504 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59ded86a9924cf19433fe2adb3cea6e'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:52.063261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 920/1843] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:51 2022] DELETE /identity/v3/users/c59ded86a9924cf19433fe2adb3cea6e => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:52.070525 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:52.074718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:52.182767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:52.184238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ba5ef-197f-4b57-872e-4ce078386a22 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:52.202481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 924/1844] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:51 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:52.205250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2393-4898-4884-b709-db8747260076 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:52.205546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2393-4898-4884-b709-db8747260076 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:52.206417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f2393-4898-4884-b709-db8747260076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:52.216896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb7651-6ca5-4277-aae1-21a5d8e3fd1b admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:52.228229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a25eed60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:52.228923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:52.229262 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:52.229577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:52.231775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:52.251907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c82f2393-4898-4884-b709-db8747260076 None None] MFA Rules not processed for user `fbad87a0396f4deb92f4da676af8bfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:52.253313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c82f2393-4898-4884-b709-db8747260076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:52.377442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:52.378925 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:52.405703 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 921/1845] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:52.446709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 925/1846] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:52.534001 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:52.535777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:52.564708 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e42e35-b707-4e57-9c8d-f0347c2370c9 service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:52.585725 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a14b4520>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:52.589052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:52.590698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:52.591164 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:52.596772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:52.751539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:52.755338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7238b776-4666-4792-96c6-13c6fe2a45f2 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:52.773278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 922/1847] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:52 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:53.313584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2393-4898-4884-b709-db8747260076 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:53.320715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c82f2393-4898-4884-b709-db8747260076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:53.473841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4496a-8ba9-484e-8d18-cc84e354f87b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:53.474442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4496a-8ba9-484e-8d18-cc84e354f87b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:53.474526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c4496a-8ba9-484e-8d18-cc84e354f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:53.507001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f2393-4898-4884-b709-db8747260076 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:53.517755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1058580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:53.518669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:53.518948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:53.519316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] PATH_INFO: `/v3/users/9a6d3454ba9b4ae1a8d94a2edd1e5037` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:53.520742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a6d3454ba9b4ae1a8d94a2edd1e5037)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:53.525066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:53.534159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-00c4496a-8ba9-484e-8d18-cc84e354f87b None None] MFA Rules not processed for user `b8c8941361fb4800ad0574237c9ac377`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:53.537982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-00c4496a-8ba9-484e-8d18-cc84e354f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:53.688200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a6d3454ba9b4ae1a8d94a2edd1e5037'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:53.689277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a6d3454ba9b4ae1a8d94a2edd1e5037'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:53.690099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a6d3454ba9b4ae1a8d94a2edd1e5037'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:53.709657 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 923/1848] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:53.736354 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a6d3454ba9b4ae1a8d94a2edd1e5037'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:53.766222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-129109d2-127b-4c32-9225-ce80a7f2dff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a6d3454ba9b4ae1a8d94a2edd1e5037'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:53.814319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 926/1849] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:53 2022] DELETE /identity/v3/users/9a6d3454ba9b4ae1a8d94a2edd1e5037 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:54.075834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f915f-844f-4b42-a0ff-5b9cbc6aa395 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.079129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f915f-844f-4b42-a0ff-5b9cbc6aa395 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.080938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f915f-844f-4b42-a0ff-5b9cbc6aa395 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.087332 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 924/1850] 10.222.0.49 () {54 vars in 912 bytes} [Fri May 13 12:54:54 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:54.101697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.102065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.102495 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.135777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] MFA Rules not processed for user `40efb0126116472aabce8459ff59bae0`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:54.139360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:54.200965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f915f-844f-4b42-a0ff-5b9cbc6aa395 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:54.208634 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-259f915f-844f-4b42-a0ff-5b9cbc6aa395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:54.275026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 927/1851] 10.222.0.49 () {58 vars in 1009 bytes} [Fri May 13 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:54.329522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:54.331681 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:54.384412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfeab77-6417-4b75-a5e0-e2d75a5200da None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:54.399041 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6806a94-f0e1-4a27-b2e4-54cc91688dc4 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a18455e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:54.401534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806a94-f0e1-4a27-b2e4-54cc91688dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.402843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806a94-f0e1-4a27-b2e4-54cc91688dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.403315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6806a94-f0e1-4a27-b2e4-54cc91688dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.430210 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806a94-f0e1-4a27-b2e4-54cc91688dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:54.431993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6806a94-f0e1-4a27-b2e4-54cc91688dc4 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:54.454702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f915f-844f-4b42-a0ff-5b9cbc6aa395 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:54.461852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 928/1852] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:54.471354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=9VcDTi5JSMCn-O_BHSLn6w, audit_chain_id=['9VcDTi5JSMCn-O_BHSLn6w']) at 0x7fe8a1129d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:54.472481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.472911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.473380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] PATH_INFO: `/v3/projects/c91ba225781d4a4881f5e70aecb23452` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.474831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c91ba225781d4a4881f5e70aecb23452)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:54.477466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:54.599267 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c91ba225781d4a4881f5e70aecb23452', 'request_id': 'req-210e7270-42b1-4a98-bea2-4d573712d637'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:54.619300 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c91ba225781d4a4881f5e70aecb23452', 'request_id': 'req-210e7270-42b1-4a98-bea2-4d573712d637'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:54.635758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c91ba225781d4a4881f5e70aecb23452', 'request_id': 'req-210e7270-42b1-4a98-bea2-4d573712d637'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:54.661580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] The token cache is being invalidate because project c91ba225781d4a4881f5e70aecb23452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:54.661856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:54.663038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-210e7270-42b1-4a98-bea2-4d573712d637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:54.666256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 925/1853] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:54 2022] DELETE /identity/v3/projects/c91ba225781d4a4881f5e70aecb23452 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:54.671060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.671563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.671843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.725447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:54.726703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:54.863912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 929/1854] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:54.878078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.878354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.878865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.920144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:54.925154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:54.940506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 926/1855] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:54.945779 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:54.974857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a67b3b5-8f20-4bd2-8e62-0c2bdda8a9b1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:54.985142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a0ff3370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:54.986387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:54.986908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:54.987371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:54.988851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:54.989455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:54.991554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.020214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.036724 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 930/1856] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:54:55.044637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d8e5b-796c-43d4-826e-0964179afae8 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.057753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a1a0e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.059005 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.059497 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.059998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.060923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.063743 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.098256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.100901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.142200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a640094-c7d3-4579-82ff-d81ba04f7bf3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.145899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 927/1857] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:55 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:55.149987 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.162842 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a18c5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.163729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.164034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.164279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] PATH_INFO: `/v3/projects/fb8568cfd3d44b33a25d1193a6c2de7b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.176192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb8568cfd3d44b33a25d1193a6c2de7b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.180470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.300619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb8568cfd3d44b33a25d1193a6c2de7b', 'request_id': 'req-54006a32-9b42-40dd-8484-5021fd93956c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.314329 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9540c39-d464-4b59-a168-738ab8ca7e64 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.316718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb8568cfd3d44b33a25d1193a6c2de7b', 'request_id': 'req-54006a32-9b42-40dd-8484-5021fd93956c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.329660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb8568cfd3d44b33a25d1193a6c2de7b', 'request_id': 'req-54006a32-9b42-40dd-8484-5021fd93956c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.359161 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] The token cache is being invalidate because project fb8568cfd3d44b33a25d1193a6c2de7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:55.359964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.360943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.362992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 931/1858] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:55 2022] DELETE /identity/v3/projects/fb8568cfd3d44b33a25d1193a6c2de7b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:55.367353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.369700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.445961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a1459130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.447148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.447897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.448505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.449579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.452753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.501608 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54006a32-9b42-40dd-8484-5021fd93956c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.507474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a18aa280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.508696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.509185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.509666 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] PATH_INFO: `/v3/users/be9599dbb9b6428bb96268da39799fae` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.512488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9599dbb9b6428bb96268da39799fae)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.513552 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 928/1859] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:55 2022] POST /identity/v3/users => generated 286 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:55.514571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.516359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.516474 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.531396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86427efb-a2e3-46cb-a614-0acf8553b032 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.542498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a19a32b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.544637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.546098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.546904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] PATH_INFO: `/v3/users/c07748e643cc49818b91b0599236d242` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.548674 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07748e643cc49818b91b0599236d242)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.551394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.587824 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9599dbb9b6428bb96268da39799fae'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.588614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9599dbb9b6428bb96268da39799fae'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.589425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9599dbb9b6428bb96268da39799fae'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.605574 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9599dbb9b6428bb96268da39799fae'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.621166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9599dbb9b6428bb96268da39799fae'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.643789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07748e643cc49818b91b0599236d242'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.644965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07748e643cc49818b91b0599236d242'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.645167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07748e643cc49818b91b0599236d242'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.654044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 932/1860] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:55 2022] DELETE /identity/v3/users/be9599dbb9b6428bb96268da39799fae => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:55.657771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.661437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.663081 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07748e643cc49818b91b0599236d242'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.675328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24f49b6e-189d-403f-9591-e36e62f7d6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07748e643cc49818b91b0599236d242'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:55.696913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 929/1861] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:55 2022] DELETE /identity/v3/users/c07748e643cc49818b91b0599236d242 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:55.696913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9c77-77c9-409a-8f6a-c9695be97d44 None None] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.696913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9c77-77c9-409a-8f6a-c9695be97d44 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.696913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc9c77-77c9-409a-8f6a-c9695be97d44 None None] PATH_INFO: `/` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.698126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 930/1862] 10.222.0.49 () {54 vars in 921 bytes} [Fri May 13 12:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:55.700591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a94a-91ff-4681-ad44-9e2c75e4f354 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.700678 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a94a-91ff-4681-ad44-9e2c75e4f354 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.701033 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236a94a-91ff-4681-ad44-9e2c75e4f354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.722205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4236a94a-91ff-4681-ad44-9e2c75e4f354 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:55.724085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4236a94a-91ff-4681-ad44-9e2c75e4f354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.795297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb3da4-4f2b-497d-a13a-584ad88000ff admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.800259 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 931/1863] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:55.801802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.802155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.802449 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.810983 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a1526130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.811834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.812249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.812588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.813419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.815111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.823430 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:55.825406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.836084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 933/1864] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:55.840279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.843081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.862243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e6d09-746f-4c5e-973d-75524ddd321b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:55.867438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a1895190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:55.869990 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:55.870362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:55.871474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:55.872326 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:55.874078 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:55.907628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 934/1865] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:55.910619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.914711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:55.958719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 932/1866] 10.222.0.49 () {58 vars in 1018 bytes} [Fri May 13 12:54:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:55.967323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:55.993278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aa7e8-a840-4147-afd8-a2e5279b0dfd None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:56.003819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26042f4e-29f1-471e-841e-6a36a64f693b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a25eed60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:56.006080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26042f4e-29f1-471e-841e-6a36a64f693b admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:56.006387 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26042f4e-29f1-471e-841e-6a36a64f693b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:56.007233 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26042f4e-29f1-471e-841e-6a36a64f693b admin admin] PATH_INFO: `/v3/projects/88dc8239c33a43a0b8f88053e88b6370/users/22c3a5954375451c9771c95102e8b783/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:56.038772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26042f4e-29f1-471e-841e-6a36a64f693b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88dc8239c33a43a0b8f88053e88b6370, user_id=22c3a5954375451c9771c95102e8b783, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:56.042084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeac27-8422-48e5-b315-e6ff699fa4df admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:56.043004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26042f4e-29f1-471e-841e-6a36a64f693b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:56.047228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a183df10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:56.047887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:56.048164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:56.048493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:56.069643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:56.071449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:56.071990 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 933/1867] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:55 2022] PUT /identity/v3/projects/88dc8239c33a43a0b8f88053e88b6370/users/22c3a5954375451c9771c95102e8b783/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:56.087094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:56.090485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:56.091068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:56.099474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 935/1868] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:56.133146 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:56.134810 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:56.250148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 934/1869] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:56.265837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:56.267334 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:56.290834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5ed79-f24d-491e-a918-82473beeb06d service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:56.470382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a187d100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:56.471637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:56.471943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:56.474412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:56.502086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:56.507022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:56.536136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 936/1870] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:56.713225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:56.715971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:56.723094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:56.727273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:56.757686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96b45a5-6b8f-4191-9256-d7bdbc5cb7bc service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:56.776423 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=CepA0ZSESyS6bDl2sCMPiA, audit_chain_id=['CepA0ZSESyS6bDl2sCMPiA']) at 0x7fe8a1841220>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:56.777340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:56.777616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:56.777887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] PATH_INFO: `/v3/projects/a0db6422bb06431783f18846e0768ef9` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:56.780143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0db6422bb06431783f18846e0768ef9)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:56.783703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:56.919661 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0db6422bb06431783f18846e0768ef9', 'request_id': 'req-d4963b73-f74e-4b41-af2b-8467ece71731'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:56.936277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0db6422bb06431783f18846e0768ef9', 'request_id': 'req-d4963b73-f74e-4b41-af2b-8467ece71731'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:56.946737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0db6422bb06431783f18846e0768ef9', 'request_id': 'req-d4963b73-f74e-4b41-af2b-8467ece71731'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:56.950264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b071eafe-2038-451a-96d2-69de7a8ed82e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:56.971171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] The token cache is being invalidate because project a0db6422bb06431783f18846e0768ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:56.971448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:56.972261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d4963b73-f74e-4b41-af2b-8467ece71731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:56.974593 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 937/1871] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:56 2022] DELETE /identity/v3/projects/a0db6422bb06431783f18846e0768ef9 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:56.980868 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccaa5e-4b8c-4967-8896-d30fa13474f7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:56.981488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccaa5e-4b8c-4967-8896-d30fa13474f7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:56.981849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaccaa5e-4b8c-4967-8896-d30fa13474f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.009278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-eaccaa5e-4b8c-4967-8896-d30fa13474f7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:57.011588 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eaccaa5e-4b8c-4967-8896-d30fa13474f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.118109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=WXCHqpg1TouWC97W_DBeTQ, audit_chain_id=['WXCHqpg1TouWC97W_DBeTQ']) at 0x7fe8a1872c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.119283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.119706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.120116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.122593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.139316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 938/1872] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:57.140225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.140805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.141887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.144466 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.144798 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.168942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 935/1873] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:57.169795 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.171359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.187473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5345a-6335-4676-bd46-e63868a5ba35 service nova] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.195462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a160e850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.198074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.199167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.199658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] PATH_INFO: `/v3/projects/b2906b037ae3483c9380e399e95088c7` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.201733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2906b037ae3483c9380e399e95088c7)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.205072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.244846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:57.249956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.274261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 939/1874] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:57.277607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.305520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a9a67-e94c-4605-8065-9ce8a77d2584 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.317641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2906b037ae3483c9380e399e95088c7', 'request_id': 'req-f65bcb78-b68d-4238-9233-a065bbb93e8a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.337833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2906b037ae3483c9380e399e95088c7', 'request_id': 'req-f65bcb78-b68d-4238-9233-a065bbb93e8a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.347796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2906b037ae3483c9380e399e95088c7', 'request_id': 'req-f65bcb78-b68d-4238-9233-a065bbb93e8a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.371198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] The token cache is being invalidate because project b2906b037ae3483c9380e399e95088c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:57.371651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.372796 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.375039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 936/1875] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:57 2022] DELETE /identity/v3/projects/b2906b037ae3483c9380e399e95088c7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:57.379170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.384631 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.452034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1841580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.452837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.453055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.453345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.454087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:57.454399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.456039 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.488277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 940/1876] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:57.496224 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.503286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.531912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65bcb78-b68d-4238-9233-a065bbb93e8a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.539341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a19b5160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.541999 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.542266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.542883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] PATH_INFO: `/v3/users/684919e3a62a4cc38e3524049eb21d0d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.543289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d2a29-30e1-4917-ac9a-143501bd656c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.544724 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=684919e3a62a4cc38e3524049eb21d0d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.547582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.555380 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1c75070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.556425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.556926 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.557382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.558425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.561789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.602843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 941/1877] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:57 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:57.606880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.633413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '684919e3a62a4cc38e3524049eb21d0d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.634322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '684919e3a62a4cc38e3524049eb21d0d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.635923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '684919e3a62a4cc38e3524049eb21d0d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.653870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '684919e3a62a4cc38e3524049eb21d0d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.662957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '684919e3a62a4cc38e3524049eb21d0d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:57.690234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556ff24-5d46-4c59-9462-2670695fb9f4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.695560 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a10a2ee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.696245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.696524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.696795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.697524 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.697995 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 937/1878] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:54:57 2022] DELETE /identity/v3/users/684919e3a62a4cc38e3524049eb21d0d => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:57.700002 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.753649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 942/1879] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:57 2022] POST /identity/v3/users => generated 286 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:57.758571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.760306 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:57.865629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda3882-df8b-40a0-b9e2-52abcd14a538 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.874378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a10e1a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.875507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.875507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.876025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.876862 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.879084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.892391 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 938/1880] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:57.896434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.907726 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252381a8-fe8b-4618-a886-44d2da38094b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.914286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1819e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.915193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.915599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.915939 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.916823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.919331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:57.934664 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 943/1881] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:57.935892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:57.946932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972cddb8-4f59-4d88-a2a3-cac9f780090d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:57.953161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f210cd5-a7b0-4a3d-9d0e-063f1dd423d4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a11edf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:57.954414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f210cd5-a7b0-4a3d-9d0e-063f1dd423d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:57.954414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f210cd5-a7b0-4a3d-9d0e-063f1dd423d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:57.954601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f210cd5-a7b0-4a3d-9d0e-063f1dd423d4 admin admin] PATH_INFO: `/v3/projects/3364902928b1495ca695449d490a4986/users/95ec86020ddb4e41be9561d1c03feffc/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:57.988105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f210cd5-a7b0-4a3d-9d0e-063f1dd423d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3364902928b1495ca695449d490a4986, user_id=95ec86020ddb4e41be9561d1c03feffc, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:57.991046 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f210cd5-a7b0-4a3d-9d0e-063f1dd423d4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.010986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.012731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.017344 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 939/1882] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:57 2022] PUT /identity/v3/projects/3364902928b1495ca695449d490a4986/users/95ec86020ddb4e41be9561d1c03feffc/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:58.024302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.024601 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.024865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.031591 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a85e6-9083-4e64-ab67-54eef7a42dc9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.065656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] MFA Rules not processed for user `95ec86020ddb4e41be9561d1c03feffc`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:58.066978 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.106422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=sgczRchNQnyCCORzi2Jo9Q, audit_chain_id=['sgczRchNQnyCCORzi2Jo9Q']) at 0x7fe8a1056340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.107435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.108277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.108277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] PATH_INFO: `/v3/projects/42b8335cfd42431b89a83fcf03789a4a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.109631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] RBAC: Authorizing `identity:delete_project(project_id=42b8335cfd42431b89a83fcf03789a4a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.111946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.145953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 940/1883] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:54:58.151178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.165572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f71eb1-ab02-40d2-92cd-293189877b04 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.174055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42b8335cfd42431b89a83fcf03789a4a', 'request_id': 'req-4425f995-c705-40e5-bc68-3b6a510f849d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:58.196802 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42b8335cfd42431b89a83fcf03789a4a', 'request_id': 'req-4425f995-c705-40e5-bc68-3b6a510f849d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:58.208496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42b8335cfd42431b89a83fcf03789a4a', 'request_id': 'req-4425f995-c705-40e5-bc68-3b6a510f849d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:58.221491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] The token cache is being invalidate because project 42b8335cfd42431b89a83fcf03789a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:54:58.221919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:58.222646 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4425f995-c705-40e5-bc68-3b6a510f849d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:54:58.224490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 944/1884] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:54:58 2022] DELETE /identity/v3/projects/42b8335cfd42431b89a83fcf03789a4a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:54:58.225846 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.226123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.226396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.240715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c797b-884e-453c-8735-1a717998e121 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1176250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.241569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c797b-884e-453c-8735-1a717998e121 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.241853 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c797b-884e-453c-8735-1a717998e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.242125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c797b-884e-453c-8735-1a717998e121 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.242930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c797b-884e-453c-8735-1a717998e121 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.246817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c797b-884e-453c-8735-1a717998e121 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.255044 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] MFA Rules not processed for user `22c3a5954375451c9771c95102e8b783`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:58.256184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.290367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 941/1885] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:54:58.292034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.293109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.293527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.328607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:58.330839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.394971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 945/1886] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:58.396977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.399385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.425353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4208e5-cd73-4d14-bb70-3715c69c9411 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.490583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 942/1887] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:58.491568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.493282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.508589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8d09b-3cf5-4110-ab57-c10d6518eccd None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.517140 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f3866-0b2a-4999-9b8b-cf77f25b8acc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a14a76a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.518090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3866-0b2a-4999-9b8b-cf77f25b8acc admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.518536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3866-0b2a-4999-9b8b-cf77f25b8acc admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.519262 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f3866-0b2a-4999-9b8b-cf77f25b8acc admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.520156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f3866-0b2a-4999-9b8b-cf77f25b8acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.524147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f3866-0b2a-4999-9b8b-cf77f25b8acc admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.531490 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1895190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.532227 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.532469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.532743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.533497 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.535505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.571052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 943/1888] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:58.571052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.571052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.571388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.580193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 946/1889] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:58.581441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.596973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a638d-7cb6-4a74-be3f-2d41a7761e95 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.604549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:58.607192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:58.701656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a10a2550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.702546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.702930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.703309 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.704256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.721697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.733548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 944/1890] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:58.735491 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.762827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb62a7-b1a5-423b-9f91-2e4034b1c6a1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.783203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 947/1891] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:58.786992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.788106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1190ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.789376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.805121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.805121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.805121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.805121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.820286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373291a-481f-43ae-8efb-0f06466d8819 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.826828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 945/1892] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:58.827834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.853907 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f76db-2ffa-458c-843b-c5d9f6186d34 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.857844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a181c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.858557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.858848 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.859132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.859883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:54:58.860197 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.860312 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a1833e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.861016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.861339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.862010 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.863236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.863373 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.864494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.875435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 946/1893] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:58.876385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.895126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5b4bf-f988-4d56-ab5d-5025ce0fd4fd admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.903251 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a1096370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.905190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.905593 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.905935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] PATH_INFO: `/v3/projects/4e21c219e7b246ec96c4b3b9cebf3f81/users/56a3091e1eb847a68aba80f34b267e73/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.911244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 948/1894] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:54:58.912156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.926983 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e21c219e7b246ec96c4b3b9cebf3f81, user_id=56a3091e1eb847a68aba80f34b267e73, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.928304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e815f0c5-6c0d-4f31-ae0d-881115eb90dc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:58.931919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.938633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a17d3e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:58.939626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:58.939910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:58.940164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] PATH_INFO: `/v3/projects/5137506c1663449db67a8ef895d4bfa2/users/945f2526901a4d1b883ef95631a5c795/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:58.957123 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 947/1895] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:58 2022] PUT /identity/v3/projects/4e21c219e7b246ec96c4b3b9cebf3f81/users/56a3091e1eb847a68aba80f34b267e73/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:58.961378 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:58.970070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5137506c1663449db67a8ef895d4bfa2, user_id=945f2526901a4d1b883ef95631a5c795, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:58.978151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:58.999862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 949/1896] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:58 2022] PUT /identity/v3/projects/5137506c1663449db67a8ef895d4bfa2/users/945f2526901a4d1b883ef95631a5c795/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:58.999862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.063595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a65a-9525-435b-8652-9a29922676a2 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.104544 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada5ecc1-fcab-4146-904c-0674ba8b6793 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.113770 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a10a2790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.114587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.115316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.115696 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.116568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.118453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.133777 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 950/1897] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:59.134723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.149353 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8243aca-e17a-4500-a252-f5e4f380eda1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.151581 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a14f1d90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.152375 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.153093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.153505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.154293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.156819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.157545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a182c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.158345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.158727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.159109 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.159950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.162070 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.175190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 951/1898] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:59.176649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.189576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d150a-d039-4d6c-b5d5-762f63bf47b2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.197846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 948/1899] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:54:58 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:59.198749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.204107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a109cf70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.206248 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.207890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.208274 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] PATH_INFO: `/v3/projects/4e21c219e7b246ec96c4b3b9cebf3f81/users/56a3091e1eb847a68aba80f34b267e73/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.212513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e21c219e7b246ec96c4b3b9cebf3f81, user_id=56a3091e1eb847a68aba80f34b267e73, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.217993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.251876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 952/1900] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:59 2022] PUT /identity/v3/projects/4e21c219e7b246ec96c4b3b9cebf3f81/users/56a3091e1eb847a68aba80f34b267e73/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:59.252950 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.344534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665945a7-7e42-4ddc-a034-489aaf0382ce admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.403986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a441af-b008-45e9-803b-fa504607a115 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.409110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1841580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.409881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.410276 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.410615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.412748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.413956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.434955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a80dc8-ec49-4e04-aeac-a0f00c5d6fc8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a14d7e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.436149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a80dc8-ec49-4e04-aeac-a0f00c5d6fc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.436431 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a80dc8-ec49-4e04-aeac-a0f00c5d6fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.436701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a80dc8-ec49-4e04-aeac-a0f00c5d6fc8 admin admin] PATH_INFO: `/v3/projects/5137506c1663449db67a8ef895d4bfa2/users/945f2526901a4d1b883ef95631a5c795/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.439191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a80dc8-ec49-4e04-aeac-a0f00c5d6fc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5137506c1663449db67a8ef895d4bfa2, user_id=945f2526901a4d1b883ef95631a5c795, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.442754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a80dc8-ec49-4e04-aeac-a0f00c5d6fc8 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.457617 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 949/1901] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:59 2022] PUT /identity/v3/projects/5137506c1663449db67a8ef895d4bfa2/users/945f2526901a4d1b883ef95631a5c795/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:59.458411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 953/1902] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:54:59 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:54:59.461832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.462242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.462588 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.462877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.488552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518b0bb-7f73-472b-9e06-f1ad581120de admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.528690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] MFA Rules not processed for user `56a3091e1eb847a68aba80f34b267e73`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:59.530136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:59.613098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a0f79cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.614602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.619014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.620439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.624398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.628030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 950/1903] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:54:59.630069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.637396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.639613 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:59.643687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 954/1904] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:59.647162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.691780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8aa27-923e-4376-8a24-cb0aa183b7fd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.732073 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb68dacd-811d-4e02-9e76-372bd59e0112 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.732577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64c98-1532-4ee7-a7ed-422d28f4a9c6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1541bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.733392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64c98-1532-4ee7-a7ed-422d28f4a9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.737624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553be1ea-fd9d-4d7b-89c2-2b0b275df3c1 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a120bca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.738129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64c98-1532-4ee7-a7ed-422d28f4a9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.738445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64c98-1532-4ee7-a7ed-422d28f4a9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.738935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be1ea-fd9d-4d7b-89c2-2b0b275df3c1 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.739216 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64c98-1532-4ee7-a7ed-422d28f4a9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.740261 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be1ea-fd9d-4d7b-89c2-2b0b275df3c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.740849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64c98-1532-4ee7-a7ed-422d28f4a9c6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.741087 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553be1ea-fd9d-4d7b-89c2-2b0b275df3c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.752327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553be1ea-fd9d-4d7b-89c2-2b0b275df3c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.754989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553be1ea-fd9d-4d7b-89c2-2b0b275df3c1 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.766255 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 955/1905] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:54:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:54:59.771932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa003-a304-4d9e-991e-1347423042e9 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.773289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa003-a304-4d9e-991e-1347423042e9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.777839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8aa003-a304-4d9e-991e-1347423042e9 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.780477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 956/1906] 10.222.0.49 () {54 vars in 921 bytes} [Fri May 13 12:54:59 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 13 12:54:59.783237 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 951/1907] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:54:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:54:59.786086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aa003-a304-4d9e-991e-1347423042e9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:54:59.815577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8aa003-a304-4d9e-991e-1347423042e9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:54:59.827278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.827566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.827841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.828460 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae921ff-1cb5-4297-9f50-eaae9a779c72 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1525490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:54:59.833611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae921ff-1cb5-4297-9f50-eaae9a779c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.833908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae921ff-1cb5-4297-9f50-eaae9a779c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.834192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae921ff-1cb5-4297-9f50-eaae9a779c72 admin admin] PATH_INFO: `/v3/projects/de335b9b2c5542cf97a80503382c9f4e/users/47adb6f47d6644fe9a2b5349178d4a4f/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:54:59.897466 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] MFA Rules not processed for user `97df92a4d0e543f79e611b9bfd03e1c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:54:59.905456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:54:59.912195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae921ff-1cb5-4297-9f50-eaae9a779c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de335b9b2c5542cf97a80503382c9f4e, user_id=47adb6f47d6644fe9a2b5349178d4a4f, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:54:59.919599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae921ff-1cb5-4297-9f50-eaae9a779c72 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:54:59.951946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 957/1908] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:54:59 2022] PUT /identity/v3/projects/de335b9b2c5542cf97a80503382c9f4e/users/47adb6f47d6644fe9a2b5349178d4a4f/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:54:59.964635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:54:59.965152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:54:59.965837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.042665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] MFA Rules not processed for user `47adb6f47d6644fe9a2b5349178d4a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:00.043806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:00.100408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 952/1909] 10.222.0.49 () {58 vars in 1018 bytes} [Fri May 13 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:00.101316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.104108 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:00.129446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ced6f-74ef-498e-ba08-a6008f489d55 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.177583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 958/1910] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:54:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:00.185415 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.258507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a14ddc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.259187 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.259492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.259749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.263059 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:00.333913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89d0ad-8385-4cf7-889a-11df822068e4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.340551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1b73610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.341306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.341833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.342112 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.342811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.344744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.395641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 959/1911] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:00 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:00.396639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.400156 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:00.424363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.427993 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.448668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 953/1912] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:00.450289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.471977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf7075-6e10-47af-abc9-451adb179908 service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.526492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539ae97-076e-4583-a547-a356c80f4ad1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.535128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=WXCHqpg1TouWC97W_DBeTQ, audit_chain_id=['WXCHqpg1TouWC97W_DBeTQ']) at 0x7fe8a1822340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.535962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.536533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.536837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.569230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.571208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.593659 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 960/1913] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:00.599160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1464af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.600517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.601264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.601837 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.603231 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.606705 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.634999 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 954/1914] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:00 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:00.640416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.655491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411d613-a7f7-44a9-a9ba-fb275ea0c258 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.661504 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a0f9f400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.664891 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.665257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.665554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.666290 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.668652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.681301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 961/1915] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:00.686968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.700335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571ee0f-a165-40c8-a759-f43b641f411d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.706118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a14dda00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.707069 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.707396 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.707620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] PATH_INFO: `/v3/projects/42447a444ef544bc97caf12edc1e1042/users/89ba17896e6b45e0941ef2325b068676/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.726446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42447a444ef544bc97caf12edc1e1042, user_id=89ba17896e6b45e0941ef2325b068676, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.729502 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.749428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 955/1916] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:00 2022] PUT /identity/v3/projects/42447a444ef544bc97caf12edc1e1042/users/89ba17896e6b45e0941ef2325b068676/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:00.750631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.762243 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0fbd81-bfe6-47ef-82ba-e2f8beb2c953 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.832159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ded745-7a3a-4fd3-9653-377aff6c32e9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a17dfc70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.833061 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded745-7a3a-4fd3-9653-377aff6c32e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.833292 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded745-7a3a-4fd3-9653-377aff6c32e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.833563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ded745-7a3a-4fd3-9653-377aff6c32e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.834395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ded745-7a3a-4fd3-9653-377aff6c32e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.836371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ded745-7a3a-4fd3-9653-377aff6c32e9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.849599 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 962/1917] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:00.853706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:00.866973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb54a6-9a21-49de-b1b0-89de81a493f3 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:00.871347 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1528310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:00.873110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.873498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.873872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] PATH_INFO: `/v3/projects/42447a444ef544bc97caf12edc1e1042/users/89ba17896e6b45e0941ef2325b068676/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.876444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42447a444ef544bc97caf12edc1e1042, user_id=89ba17896e6b45e0941ef2325b068676, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:00.879572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:00.902935 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 956/1918] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:00 2022] PUT /identity/v3/projects/42447a444ef544bc97caf12edc1e1042/users/89ba17896e6b45e0941ef2325b068676/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:00.905697 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:00.906050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:00.906434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:00.936320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] MFA Rules not processed for user `89ba17896e6b45e0941ef2325b068676`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:00.937725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:01.017981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 963/1919] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:01.039966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:01.147152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d798d8-8c8a-4cd2-a5f3-b17ee74bfec7 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:01.152520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34eb61-df32-4b68-81f0-fd99c5f3d1e7 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a14f1850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:01.153215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34eb61-df32-4b68-81f0-fd99c5f3d1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:01.153495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34eb61-df32-4b68-81f0-fd99c5f3d1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:01.153917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34eb61-df32-4b68-81f0-fd99c5f3d1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:01.173091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34eb61-df32-4b68-81f0-fd99c5f3d1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:01.175134 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34eb61-df32-4b68-81f0-fd99c5f3d1e7 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:01.193751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 957/1920] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:01.267406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:01.370110 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9692757-6dc9-4e62-9dba-fed301ec879a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:01.377908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a0ffb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:01.379335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:01.379743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:01.380150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] PATH_INFO: `/v3/users/47adb6f47d6644fe9a2b5349178d4a4f` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:01.382585 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] RBAC: Authorizing `identity:delete_user(user_id=47adb6f47d6644fe9a2b5349178d4a4f)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:01.389420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:01.527580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47adb6f47d6644fe9a2b5349178d4a4f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:01.528728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47adb6f47d6644fe9a2b5349178d4a4f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:01.530866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47adb6f47d6644fe9a2b5349178d4a4f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:01.552942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47adb6f47d6644fe9a2b5349178d4a4f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:01.565018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47adb6f47d6644fe9a2b5349178d4a4f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:01.589368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 964/1921] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:01 2022] DELETE /identity/v3/users/47adb6f47d6644fe9a2b5349178d4a4f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:01.593085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5da8ef-9331-48b1-927a-2ff865fa5c89 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:01.593377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5da8ef-9331-48b1-927a-2ff865fa5c89 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:01.593962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5da8ef-9331-48b1-927a-2ff865fa5c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:01.619459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-be5da8ef-9331-48b1-927a-2ff865fa5c89 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:01.633696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-be5da8ef-9331-48b1-927a-2ff865fa5c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:01.759574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 958/1922] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:01.772103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:01.774976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:01.896916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d86bb4-732a-4f28-abe4-fc46956463af admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:01.902389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a180ca30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:01.903734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:01.904468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:01.904890 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:01.933034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:01.935616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:01.962816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 965/1923] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:02.150753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24931bb1-4c49-4177-8813-07206f05786d None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:02.151713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24931bb1-4c49-4177-8813-07206f05786d None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:02.152704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24931bb1-4c49-4177-8813-07206f05786d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:02.336322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-24931bb1-4c49-4177-8813-07206f05786d None None] MFA Rules not processed for user `945f2526901a4d1b883ef95631a5c795`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:02.337811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-24931bb1-4c49-4177-8813-07206f05786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:02.567403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 959/1924] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:02 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:02.583725 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:02.586456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:02.711383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e3884-2db7-482c-aa7c-dab676541121 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:02.716443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1b55cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:02.717429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:02.717776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:02.718122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:02.720600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:02.876658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:02.879264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b0e36-3bc0-45e9-bd2f-be6824520d65 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:02.913440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 966/1925] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:02.939505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24931bb1-4c49-4177-8813-07206f05786d None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:02.942334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-24931bb1-4c49-4177-8813-07206f05786d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:02.974923 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24931bb1-4c49-4177-8813-07206f05786d None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:02.994194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a1a09eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:02.995359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:02.996635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:02.996937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] PATH_INFO: `/v3/users/482ec568f9f748beb145e3de076748a4` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:02.999156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=482ec568f9f748beb145e3de076748a4)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:03.001154 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:03.140939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482ec568f9f748beb145e3de076748a4'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.143058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482ec568f9f748beb145e3de076748a4'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.144648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482ec568f9f748beb145e3de076748a4'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.193517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482ec568f9f748beb145e3de076748a4'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.205152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482ec568f9f748beb145e3de076748a4'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.228709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 960/1926] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:02 2022] DELETE /identity/v3/users/482ec568f9f748beb145e3de076748a4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:03.234175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:03.234549 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:03.234922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:03.264652 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:03.267354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:03.271024 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:03.273483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:03.415998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a900a4e0-6dd7-4183-aeda-85bb713d5cb4 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:03.418911 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 967/1927] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:03.426793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a1575c70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:03.431363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:03.431953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:03.432517 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] PATH_INFO: `/v3/projects/de335b9b2c5542cf97a80503382c9f4e` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:03.432896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:03.435538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:03.437063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de335b9b2c5542cf97a80503382c9f4e)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:03.442162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:03.517046 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de335b9b2c5542cf97a80503382c9f4e', 'request_id': 'req-860ea359-8292-4b6a-b7ed-c42d6525a294'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.537887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de335b9b2c5542cf97a80503382c9f4e', 'request_id': 'req-860ea359-8292-4b6a-b7ed-c42d6525a294'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.548464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de335b9b2c5542cf97a80503382c9f4e', 'request_id': 'req-860ea359-8292-4b6a-b7ed-c42d6525a294'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.549630 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32411b5d-071b-4693-a610-c30330b9e08a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:03.578184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] The token cache is being invalidate because project de335b9b2c5542cf97a80503382c9f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:03.580209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.581753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.585568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 961/1928] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:03 2022] DELETE /identity/v3/projects/de335b9b2c5542cf97a80503382c9f4e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:03.590509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:03.593183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:03.631968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a182b190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:03.633816 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:03.634097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:03.638206 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:03.651776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:03.732404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:03.734088 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:03.747700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 968/1929] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:03.755882 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea359-8292-4b6a-b7ed-c42d6525a294 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:03.766742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a120bca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:03.767824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:03.768116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:03.768648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] PATH_INFO: `/v3/users/89ba17896e6b45e0941ef2325b068676` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:03.770153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ba17896e6b45e0941ef2325b068676)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:03.772942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:03.856104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ba17896e6b45e0941ef2325b068676'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.857781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ba17896e6b45e0941ef2325b068676'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.859364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ba17896e6b45e0941ef2325b068676'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.903635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ba17896e6b45e0941ef2325b068676'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.937450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ba17896e6b45e0941ef2325b068676'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:03.970414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 962/1930] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:03 2022] DELETE /identity/v3/users/89ba17896e6b45e0941ef2325b068676 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:04.542338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:04.544880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:04.603870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:04.607256 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:04.612897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836ab46-ac21-4d3f-b3a9-4bb6227a93f4 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:04.677911 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a17ee580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:04.678792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:04.679145 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:04.680166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:04.683459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:04.719012 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32b232-98d5-49fc-ac38-6c214d5bb0ac admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:04.723781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a14eaaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:04.724635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:04.724910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:04.725208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] PATH_INFO: `/v3/projects/877f12f680e44a2c9f48482d2e957675` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:04.726388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=877f12f680e44a2c9f48482d2e957675)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:04.728282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:04.752384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:04.753757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:04.765455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 969/1931] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:04 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:04.766618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:04.768066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:04.779112 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '877f12f680e44a2c9f48482d2e957675', 'request_id': 'req-62652635-bcbf-4c71-9715-c3a46f5d2e69'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.783477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c59e1-adb4-46fd-b9b2-d58ad2ee0baf service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:04.792899 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '877f12f680e44a2c9f48482d2e957675', 'request_id': 'req-62652635-bcbf-4c71-9715-c3a46f5d2e69'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.800770 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '877f12f680e44a2c9f48482d2e957675', 'request_id': 'req-62652635-bcbf-4c71-9715-c3a46f5d2e69'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.813755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] The token cache is being invalidate because project 877f12f680e44a2c9f48482d2e957675 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:04.814073 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.814735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.816618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 963/1932] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:04 2022] DELETE /identity/v3/projects/877f12f680e44a2c9f48482d2e957675 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:04.820418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:04.821972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:04.881571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=3p2mSEyRS_60VsIhxCcwfA, audit_chain_id=['3p2mSEyRS_60VsIhxCcwfA']) at 0x7fe8a182c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:04.882882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:04.883170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:04.883485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] PATH_INFO: `/v3/projects/42447a444ef544bc97caf12edc1e1042` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:04.884801 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42447a444ef544bc97caf12edc1e1042)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:04.887557 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:04.921523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652635-bcbf-4c71-9715-c3a46f5d2e69 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:04.934004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a1604bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:04.934004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:04.934004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:04.934004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] PATH_INFO: `/v3/users/c59dbe3ceec8403e8c42ad18f4919b8d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:04.934408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c59dbe3ceec8403e8c42ad18f4919b8d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:04.934408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:04.943714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42447a444ef544bc97caf12edc1e1042', 'request_id': 'req-28d2e64d-1cfe-458e-a415-328654eed2e4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.957579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42447a444ef544bc97caf12edc1e1042', 'request_id': 'req-28d2e64d-1cfe-458e-a415-328654eed2e4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.964196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42447a444ef544bc97caf12edc1e1042', 'request_id': 'req-28d2e64d-1cfe-458e-a415-328654eed2e4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.997544 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] The token cache is being invalidate because project 42447a444ef544bc97caf12edc1e1042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:04.999556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c59dbe3ceec8403e8c42ad18f4919b8d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:04.999953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.001058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-28d2e64d-1cfe-458e-a415-328654eed2e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.002494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c59dbe3ceec8403e8c42ad18f4919b8d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.003548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 970/1933] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:04 2022] DELETE /identity/v3/projects/42447a444ef544bc97caf12edc1e1042 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:05.005089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c59dbe3ceec8403e8c42ad18f4919b8d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.010219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.013301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.013670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.029835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c59dbe3ceec8403e8c42ad18f4919b8d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.048178 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:05.049607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.057719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f4441936-d0c8-4366-8d09-b16963029584 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c59dbe3ceec8403e8c42ad18f4919b8d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.085856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 964/1934] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:04 2022] DELETE /identity/v3/users/c59dbe3ceec8403e8c42ad18f4919b8d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:05.169388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 971/1935] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:05.170860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.171799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.171799 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.196723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:05.198130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.280342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 965/1936] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:05.284675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.298188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8df0a1-7d81-433d-94ca-1479d07c15a4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.305277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a0fd7e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.306416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.306700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.307123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.308652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:05.308894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.310516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.348894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 972/1937] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:05.350683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.362869 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d0515-b2eb-4c8e-8d40-87aab146db06 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.372390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1529640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.372550 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.372848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.374575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.377975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.380707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.420083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 966/1938] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:05.421217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.433721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da713f22-64fd-4374-8e78-2114d274c0c0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.546028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a15791c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.546745 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.547027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.547258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.548113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.550090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.585499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 973/1939] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:05.589440 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.618865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929dfa0-5efb-4081-a423-a9be53414f76 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.621341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.623475 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.628420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a14a76a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.629249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.629532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.629804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.630539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.632170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.638123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c704e-5be4-46d8-8faa-9962864df60d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.642980 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=ngZrVR96Q5athmrfBNxSaw, audit_chain_id=['ngZrVR96Q5athmrfBNxSaw']) at 0x7fe8a1b73610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.643850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.644133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.644404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] PATH_INFO: `/v3/projects/6124bc5aa7ab4099b052f88859b7436b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.645413 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 967/1940] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:05.648572 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6124bc5aa7ab4099b052f88859b7436b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.649143 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.650885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.659589 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d90f089-e1eb-4a02-9411-5d4012d5d762 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.664687 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1459e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.665324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.665606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.665878 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.666608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.668690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.679025 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 968/1941] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:05.684599 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.697017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c980df-4ac7-401e-bf04-5ceeef6aedc4 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.702681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdfaf46-1d9b-4192-a7a8-056e63c67996 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a183fd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.703820 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfaf46-1d9b-4192-a7a8-056e63c67996 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.704103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfaf46-1d9b-4192-a7a8-056e63c67996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.704381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdfaf46-1d9b-4192-a7a8-056e63c67996 admin admin] PATH_INFO: `/v3/projects/64b4bde38a154b9e93021844f76a0249/users/b8f61efd8e104b48be563464794be2a6/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.718056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6124bc5aa7ab4099b052f88859b7436b', 'request_id': 'req-b158155c-470a-4e67-9937-8f9589dba103'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.720571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfaf46-1d9b-4192-a7a8-056e63c67996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b4bde38a154b9e93021844f76a0249, user_id=b8f61efd8e104b48be563464794be2a6, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.723746 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdfaf46-1d9b-4192-a7a8-056e63c67996 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.727896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6124bc5aa7ab4099b052f88859b7436b', 'request_id': 'req-b158155c-470a-4e67-9937-8f9589dba103'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.735547 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6124bc5aa7ab4099b052f88859b7436b', 'request_id': 'req-b158155c-470a-4e67-9937-8f9589dba103'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.739582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 969/1942] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:05 2022] PUT /identity/v3/projects/64b4bde38a154b9e93021844f76a0249/users/b8f61efd8e104b48be563464794be2a6/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:05.750565 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.750849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] The token cache is being invalidate because project 6124bc5aa7ab4099b052f88859b7436b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:05.750955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.751166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.751264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.751804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b158155c-470a-4e67-9937-8f9589dba103 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:05.753452 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 974/1943] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:05 2022] DELETE /identity/v3/projects/6124bc5aa7ab4099b052f88859b7436b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:05.757953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041795f-8156-4efb-9531-3a43698ed70d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.758241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041795f-8156-4efb-9531-3a43698ed70d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.758526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041795f-8156-4efb-9531-3a43698ed70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.777702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f041795f-8156-4efb-9531-3a43698ed70d None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:05.778909 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f041795f-8156-4efb-9531-3a43698ed70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.783561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] MFA Rules not processed for user `b8f61efd8e104b48be563464794be2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:05.784741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.836669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 975/1944] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:05.844495 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.844784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.845087 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.848733 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 970/1945] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:05.853693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.855658 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.864749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:05.865949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:05.869049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44623f85-6308-46ed-aae9-b2a64c1d6c82 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.874305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a109a8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.874462 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 976/1946] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:05.874963 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.875248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.875527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.876244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.878160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.878398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.887204 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abcdf7-6646-46f9-8a2a-6b7969bdf301 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.892183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a10abcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.892453 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.892728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.893013 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.893921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:05.894263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.896131 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.910236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 971/1947] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:05.910400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 977/1948] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:55:05.911526 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.913916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:05.924244 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34da7b-1e2f-481b-99b3-f97b8d565313 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.974102 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e4f2a-eaab-43bf-8568-5bfed1242c6d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:05.978839 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a158d640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.979505 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.979783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.980767 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.980874 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a10c9610>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:05.981507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:05.981605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.981815 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:05.982085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:05.982766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:05.983451 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:05.984663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.004534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 972/1949] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:06.009326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.010943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 978/1950] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:05 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:06.014678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.018875 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10f9f0c-17be-4ea0-aa2d-6c401b9b25ba admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.075629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1459130>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.076294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.076688 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.076975 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.077722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.078788 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7f717-eada-428a-9fd5-3176c8511822 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.079463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.084476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a1549b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.085444 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.085730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.086010 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.086914 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.088886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.092622 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 973/1951] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:06.093670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.105272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5d1ffe-6f8f-4c58-a56b-124bbb12997e admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.110415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1190af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.111072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.111351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.111625 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.112463 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.114078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.116098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 979/1952] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:06.116870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.126903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf94c8b-1a50-4eb8-acdd-f08664e1f86c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.129695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 974/1953] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:06.131734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a1b55cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.132389 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.132670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.132941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.133483 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.133692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.135277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.143751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab781d-9a23-4577-9ab3-87d20e2d7681 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.148577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 980/1954] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:06.148715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cb15a-2256-46b8-82ba-ce613ae3f17e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a14d1d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.149536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cb15a-2256-46b8-82ba-ce613ae3f17e admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.149640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.149821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cb15a-2256-46b8-82ba-ce613ae3f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.150098 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cb15a-2256-46b8-82ba-ce613ae3f17e admin admin] PATH_INFO: `/v3/projects/3abf7ea16acb460aa540631541d80b62/users/c62f3752d4024fce8aa8eec9b6f0841d/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.159202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edff7a8-adc7-4e35-a7ee-b213410c3f34 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.163827 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a25999a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.164465 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.164746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.165046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.165368 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cb15a-2256-46b8-82ba-ce613ae3f17e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3abf7ea16acb460aa540631541d80b62, user_id=c62f3752d4024fce8aa8eec9b6f0841d, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.165791 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.167517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.168153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888cb15a-2256-46b8-82ba-ce613ae3f17e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.181090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 981/1955] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:06.185566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.188519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 975/1956] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:06 2022] PUT /identity/v3/projects/3abf7ea16acb460aa540631541d80b62/users/c62f3752d4024fce8aa8eec9b6f0841d/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:06.195934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb38782-85a3-4c4b-a7cd-094c1e87d4a5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.201620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.202115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.202719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.230939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] MFA Rules not processed for user `c62f3752d4024fce8aa8eec9b6f0841d`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:06.232318 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.256238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931b1a7-7b5b-4626-8750-57a4104fc909 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a1056100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.257278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b1a7-7b5b-4626-8750-57a4104fc909 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.257627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b1a7-7b5b-4626-8750-57a4104fc909 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.257974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931b1a7-7b5b-4626-8750-57a4104fc909 admin admin] PATH_INFO: `/v3/projects/29afeeefea9f48249dc012bb96241202/users/a4cf1b14ba064b52bb6482fc18fe9fb7/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.272207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b1a7-7b5b-4626-8750-57a4104fc909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29afeeefea9f48249dc012bb96241202, user_id=a4cf1b14ba064b52bb6482fc18fe9fb7, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.274981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6931b1a7-7b5b-4626-8750-57a4104fc909 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.288720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 982/1957] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:06 2022] PUT /identity/v3/projects/29afeeefea9f48249dc012bb96241202/users/a4cf1b14ba064b52bb6482fc18fe9fb7/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:06.301205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.301488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.301616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 976/1958] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:06.301764 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.306109 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.317020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cfea89-08bd-446d-aecd-4b5d650bae6a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.328185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] MFA Rules not processed for user `a4cf1b14ba064b52bb6482fc18fe9fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:06.329530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.371821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1139f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.372481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.372759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.373282 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.373966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.375877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.391876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 983/1959] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:06.401242 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 977/1960] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:06.405378 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.406573 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.408160 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.416026 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70fca4-948a-4499-a490-bc4ad059f96d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.467270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289383-3742-4226-9bf1-227d0f6576d1 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.470900 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a15310d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.471089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a131f2e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.471595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.471755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.471888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.472017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.472219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.472317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.472959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.474892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.500416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 984/1961] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:06.502285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.513106 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10771e5-a532-4f41-a4f0-245fcc107784 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.518005 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1056340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.518662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.518931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.519201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.519920 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.521569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.530576 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.535127 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.535263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 985/1962] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:06.536121 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.541435 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 978/1963] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:06.546993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d0a79b-774f-48e4-904c-578369b6f15d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.553658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a17eb310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.554943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.555172 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.555439 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] PATH_INFO: `/v3/projects/3a0a594cf6d049dc95fc8da7542005e0/users/2609dd36fa6844dab021842653351c61/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.561939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.572860 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558a17f-6294-4fc2-8ff0-9983a2c32e1d service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.576094 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0a594cf6d049dc95fc8da7542005e0, user_id=2609dd36fa6844dab021842653351c61, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.578701 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a1a09eb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.579182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.579567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.579849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.580121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] PATH_INFO: `/v3/users/a4cf1b14ba064b52bb6482fc18fe9fb7` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.581390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4cf1b14ba064b52bb6482fc18fe9fb7)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.583377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.596857 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 986/1964] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:06 2022] PUT /identity/v3/projects/3a0a594cf6d049dc95fc8da7542005e0/users/2609dd36fa6844dab021842653351c61/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:06.600527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.644200 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4cf1b14ba064b52bb6482fc18fe9fb7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:06.645675 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4cf1b14ba064b52bb6482fc18fe9fb7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:06.646379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4cf1b14ba064b52bb6482fc18fe9fb7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:06.662305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4cf1b14ba064b52bb6482fc18fe9fb7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:06.669543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247a9eb-98b3-4d21-9e5e-249fccee8476 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.674950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-1d111e77-8ee9-4b72-b5ae-4c36ce83348c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4cf1b14ba064b52bb6482fc18fe9fb7'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:06.675949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1515940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.676623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.676896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.677197 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.677922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.679522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.690999 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 987/1965] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:06.691778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 979/1966] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:06 2022] DELETE /identity/v3/users/a4cf1b14ba064b52bb6482fc18fe9fb7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:06.695618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.696692 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.697008 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.697328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.697677 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.709838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846656b5-62a7-41ad-bfbf-f6030a95e4c1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.717268 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:06.718481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.772731 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c1f14-8f58-466a-94cf-79bcefea9b43 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a17903d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.773658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1f14-8f58-466a-94cf-79bcefea9b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.773934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1f14-8f58-466a-94cf-79bcefea9b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.774201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1f14-8f58-466a-94cf-79bcefea9b43 admin admin] PATH_INFO: `/v3/projects/3a0a594cf6d049dc95fc8da7542005e0/users/2609dd36fa6844dab021842653351c61/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.776676 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c1f14-8f58-466a-94cf-79bcefea9b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0a594cf6d049dc95fc8da7542005e0, user_id=2609dd36fa6844dab021842653351c61, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.779706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 980/1967] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:06.779903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c1f14-8f58-466a-94cf-79bcefea9b43 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.789153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.790307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.791597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 988/1968] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:06 2022] PUT /identity/v3/projects/3a0a594cf6d049dc95fc8da7542005e0/users/2609dd36fa6844dab021842653351c61/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:06.802054 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.802335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.802640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.831213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] MFA Rules not processed for user `2609dd36fa6844dab021842653351c61`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:06.832403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.853191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1980aa-4fa6-4e39-8631-bd0a8355a441 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.904607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1190af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.905296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.905577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.905854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.912561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 989/1969] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:06 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:06.924879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:06.926362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:06.983930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:06.985401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:06.988864 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb360538-ffbd-467d-9c03-5fb3ec3a488a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:06.992755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a0ffb6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:06.993430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:06.993706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:06.993976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:06.994936 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 981/1970] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:07.003553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:07.004966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:07.016157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 990/1971] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:06 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:07.068825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:07.070612 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:07.084949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037955c0-c105-4f85-8556-f8f32d07d0e1 service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:07.090988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a151c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:07.093016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:07.093016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:07.093016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:07.094629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:07.219916 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:07.226727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f643b58f-06d4-4225-9a97-0d577b91fb96 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:07.241530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 982/1972] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:08.037685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:08.041273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:08.069660 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b82bda-0b89-46c4-8b5c-76932fc7e572 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:08.075887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rhcFB71hSrWpP5NrD20lkA, audit_chain_id=['rhcFB71hSrWpP5NrD20lkA']) at 0x7fe8a182b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:08.076882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:08.077207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:08.077963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] PATH_INFO: `/v3/projects/29afeeefea9f48249dc012bb96241202` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:08.079632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29afeeefea9f48249dc012bb96241202)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:08.082470 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:08.217776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29afeeefea9f48249dc012bb96241202', 'request_id': 'req-3c237532-ce96-4e84-84f7-01549bf9fb77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:08.240122 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29afeeefea9f48249dc012bb96241202', 'request_id': 'req-3c237532-ce96-4e84-84f7-01549bf9fb77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:08.272964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29afeeefea9f48249dc012bb96241202', 'request_id': 'req-3c237532-ce96-4e84-84f7-01549bf9fb77'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:08.304383 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] The token cache is being invalidate because project 29afeeefea9f48249dc012bb96241202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:08.304719 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:08.309561 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c237532-ce96-4e84-84f7-01549bf9fb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:08.311186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 991/1973] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:08 2022] DELETE /identity/v3/projects/29afeeefea9f48249dc012bb96241202 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:08.316321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:08.316736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:08.316944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:08.354433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:08.356088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:08.513031 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 983/1974] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:08.516062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:08.516359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:08.516631 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:08.541481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:08.543564 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:08.567278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 992/1975] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:08.572574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:08.589190 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a093f-5a75-45d7-b9c3-c93fa27767ad None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:08.595751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a1c72fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:08.596557 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:08.596924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:08.597304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:08.598231 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:08.598611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:08.600619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:08.625652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:08.636536 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e367bf9-f9f5-4bc7-907f-bd236a660843 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:08.637303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 984/1976] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:08.653792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a0ffb6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:08.653792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:08.654590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:08.654866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:08.655568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:08.660063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:08.722730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 993/1977] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:08 2022] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:08.724307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:08.754521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ee67cd-04a7-4836-8140-557dec0d5862 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:08.928901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a183fd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:08.929938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:08.930418 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:08.931007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:08.931856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:08.937007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:08.985027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 985/1978] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:08 2022] POST /identity/v3/users => generated 280 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:08.987774 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:08.998683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d71882f-44bc-4aad-9116-2916e3223e0c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:09.003526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a1549e50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:09.004306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.004785 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.005201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.006162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:09.008221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:09.023371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 994/1979] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:09.028958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:09.042223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8d125-4781-4ce1-ab11-d20f54db0c9c admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:09.049234 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886dc596-7186-401d-af6e-234a96b3c7f7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a1c72fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:09.050030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc596-7186-401d-af6e-234a96b3c7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.050448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc596-7186-401d-af6e-234a96b3c7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.050892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886dc596-7186-401d-af6e-234a96b3c7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.051498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc596-7186-401d-af6e-234a96b3c7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:09.053249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886dc596-7186-401d-af6e-234a96b3c7f7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:09.065835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 986/1980] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:09.070250 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:09.082399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454dc10-b49a-4b0e-b21b-03497d806979 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:09.087850 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a15264c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:09.089792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.090298 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.090627 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] PATH_INFO: `/v3/projects/dc3352d14e90478a8a71f30a0ca9e715/users/2435026f998048daacde1c4171062662/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.108882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc3352d14e90478a8a71f30a0ca9e715, user_id=2435026f998048daacde1c4171062662, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:09.112090 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:09.137739 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 995/1981] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:09 2022] PUT /identity/v3/projects/dc3352d14e90478a8a71f30a0ca9e715/users/2435026f998048daacde1c4171062662/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:09.150178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.150889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.151305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.202807 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] MFA Rules not processed for user `2435026f998048daacde1c4171062662`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:09.204299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:09.289473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 987/1982] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:09.344871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:09.346834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:09.423065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1b7a4-f413-4940-94e8-6c17e98d856c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:09.429031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd24cde7-4c5e-4888-871a-8bb3d8d7120b service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a1841580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:09.430144 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24cde7-4c5e-4888-871a-8bb3d8d7120b service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.430624 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24cde7-4c5e-4888-871a-8bb3d8d7120b service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.431100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd24cde7-4c5e-4888-871a-8bb3d8d7120b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.446999 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24cde7-4c5e-4888-871a-8bb3d8d7120b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:09.448578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd24cde7-4c5e-4888-871a-8bb3d8d7120b service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:09.461761 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 996/1983] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:09.478615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:09.557192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157f23b-27b6-4b12-b403-bd890b93f41f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:09.562490 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a14b15e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:09.563598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.563881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.564158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] PATH_INFO: `/v3/users/2435026f998048daacde1c4171062662` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.565561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2435026f998048daacde1c4171062662)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:09.567844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:09.623898 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2435026f998048daacde1c4171062662'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:09.624805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2435026f998048daacde1c4171062662'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:09.625732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2435026f998048daacde1c4171062662'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:09.644406 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2435026f998048daacde1c4171062662'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:09.653402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2435026f998048daacde1c4171062662'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:09.670394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 988/1984] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:09 2022] DELETE /identity/v3/users/2435026f998048daacde1c4171062662 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:09.675904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.676275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.676662 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.697720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:09.699817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:09.763945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 997/1985] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:09.774280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:09.776243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:09.852439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0607956-1ad4-4733-b02c-2f0cdeef1af1 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:09.857048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed2aa2-6ffa-4c98-8d9b-90f526aae882 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a19b5160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:09.857769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2aa2-6ffa-4c98-8d9b-90f526aae882 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:09.858214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2aa2-6ffa-4c98-8d9b-90f526aae882 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:09.858498 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed2aa2-6ffa-4c98-8d9b-90f526aae882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:09.869356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2aa2-6ffa-4c98-8d9b-90f526aae882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:09.871901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed2aa2-6ffa-4c98-8d9b-90f526aae882 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:09.882453 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 989/1986] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:10.161043 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.162645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:10.177332 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec709db6-6f72-4f2a-b581-ad6325ed2751 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.185198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=urQT_CLGTJugAPsydE2sTg, audit_chain_id=['urQT_CLGTJugAPsydE2sTg']) at 0x7fe8a187d100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.186889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.187203 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.187485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] PATH_INFO: `/v3/projects/dc3352d14e90478a8a71f30a0ca9e715` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.188880 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc3352d14e90478a8a71f30a0ca9e715)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.191034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.242805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc3352d14e90478a8a71f30a0ca9e715', 'request_id': 'req-a73cea68-8e33-4ac6-880a-59cd81109744'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.250888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc3352d14e90478a8a71f30a0ca9e715', 'request_id': 'req-a73cea68-8e33-4ac6-880a-59cd81109744'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.256271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc3352d14e90478a8a71f30a0ca9e715', 'request_id': 'req-a73cea68-8e33-4ac6-880a-59cd81109744'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.266834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] The token cache is being invalidate because project dc3352d14e90478a8a71f30a0ca9e715 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:10.267114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.267714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a73cea68-8e33-4ac6-880a-59cd81109744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.269333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 998/1987] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:10 2022] DELETE /identity/v3/projects/dc3352d14e90478a8a71f30a0ca9e715 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:10.274509 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.275094 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.275452 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.296579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:10.297949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:10.356903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 990/1988] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:10.365986 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.366782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.367104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.390674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:10.392050 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:10.402749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 999/1989] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:10.407381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.416951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e8099-9c9d-4c4a-bc0e-c8da61d303f1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.423570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a14eaeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.424343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.424626 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.424977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.425728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:10.426029 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.427855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.447913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 991/1990] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:10.450191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.459902 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de4a95-bb64-4b22-b742-3a2fc4ff2b13 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.469196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a1056100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.469887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.470181 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.470796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.472071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.474550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.515812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1000/1991] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:10 2022] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:10.520153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.535714 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb3889-3645-4f8e-ae5c-662c03553a7a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.597463 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.600279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:10.628965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a14d7e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.629939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.630663 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.630954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.631661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.635681 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.662985 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 992/1992] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:10 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:10.667226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.679951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2257b5f7-34ad-41ca-88af-0252e5c6189a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.684409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8ebb2-3db5-489a-b623-99fb7ff55b9b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.687833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a14da8b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.687971 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.688327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.688648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.690380 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.691443 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.701894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a1b55cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.703910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.703910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.704185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] PATH_INFO: `/v3/users/b8f61efd8e104b48be563464794be2a6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.705626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8f61efd8e104b48be563464794be2a6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.707690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.711156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 993/1993] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:10.716528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.745945 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3000a0-acb1-46f4-9ed6-072142b2c63a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.754718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a1549970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.764706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.765104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.765542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.767758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.770326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.785153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 994/1994] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:10.790088 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:10.805953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8f61efd8e104b48be563464794be2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.806969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8f61efd8e104b48be563464794be2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.807810 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8f61efd8e104b48be563464794be2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.825579 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb7ea8-ce7e-46a6-940b-6b266f2c658b admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:10.836308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8f61efd8e104b48be563464794be2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.843988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b3f77-e663-4775-ad20-31966ae95248 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a158dcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:10.844415 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b3f77-e663-4775-ad20-31966ae95248 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.844704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b3f77-e663-4775-ad20-31966ae95248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.844976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b3f77-e663-4775-ad20-31966ae95248 admin admin] PATH_INFO: `/v3/projects/0283e67e6a744080acf3ebf8d34a2c97/users/209b2b7ab7b049449f54c60b4f452a0a/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.853491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3b3e6103-5fcb-47ba-8147-948d549b5ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8f61efd8e104b48be563464794be2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:10.865068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b3f77-e663-4775-ad20-31966ae95248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0283e67e6a744080acf3ebf8d34a2c97, user_id=209b2b7ab7b049449f54c60b4f452a0a, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:10.869055 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b3f77-e663-4775-ad20-31966ae95248 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:10.875138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1001/1995] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:10 2022] DELETE /identity/v3/users/b8f61efd8e104b48be563464794be2a6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:10.880556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.881441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.882173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.894204 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 995/1996] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:10 2022] PUT /identity/v3/projects/0283e67e6a744080acf3ebf8d34a2c97/users/209b2b7ab7b049449f54c60b4f452a0a/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:10.904514 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:10.904800 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:10.905149 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:10.910898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:10.912101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:10.958302 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] MFA Rules not processed for user `209b2b7ab7b049449f54c60b4f452a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:10.959857 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:11.019141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1002/1997] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:11.029734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:11.031183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:11.108530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 996/1998] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:11.118742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:11.120130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:11.136316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115f2b89-55e0-4e91-83c7-5c0f4a4d7b69 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:11.140747 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a0f5f850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:11.141428 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:11.141706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:11.141974 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:11.163222 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:11.164883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:11.177128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1003/1999] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:11.184462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811836b-24b4-4dc8-bd53-c67d7b5ed9a0 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:11.188248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1991e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:11.188840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:11.189159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:11.189438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:11.198384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:11.200489 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:11.209815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 997/2000] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:11.501693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:11.503931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:11.528387 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4602c4e4-6bcc-4dcc-a337-2748a6afc2f1 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:11.537146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a0fd3370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:11.538291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:11.538772 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:11.539375 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] PATH_INFO: `/v3/projects/64b4bde38a154b9e93021844f76a0249` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:11.540942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b4bde38a154b9e93021844f76a0249)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:11.543129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:11.622399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b4bde38a154b9e93021844f76a0249', 'request_id': 'req-5caf5bdd-f628-4a13-ab7c-08344fd2678d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.634780 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b4bde38a154b9e93021844f76a0249', 'request_id': 'req-5caf5bdd-f628-4a13-ab7c-08344fd2678d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.644542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b4bde38a154b9e93021844f76a0249', 'request_id': 'req-5caf5bdd-f628-4a13-ab7c-08344fd2678d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.668955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] The token cache is being invalidate because project 64b4bde38a154b9e93021844f76a0249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:11.668955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.670887 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.673529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1004/2001] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:11 2022] DELETE /identity/v3/projects/64b4bde38a154b9e93021844f76a0249 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:11.677748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:11.701417 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cc79e-2a86-4447-92be-59b9fe8cc79d service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:11.776309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a19d7df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:11.777965 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:11.778255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:11.778510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] PATH_INFO: `/v3/users/c62f3752d4024fce8aa8eec9b6f0841d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:11.779755 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62f3752d4024fce8aa8eec9b6f0841d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:11.783520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:11.855372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62f3752d4024fce8aa8eec9b6f0841d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.856683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62f3752d4024fce8aa8eec9b6f0841d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.857536 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62f3752d4024fce8aa8eec9b6f0841d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.875193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62f3752d4024fce8aa8eec9b6f0841d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.884317 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62f3752d4024fce8aa8eec9b6f0841d'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:11.916486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 998/2002] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:11 2022] DELETE /identity/v3/users/c62f3752d4024fce8aa8eec9b6f0841d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:12.324402 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:12.326225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:12.340776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caf5bdd-f628-4a13-ab7c-08344fd2678d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:12.408017 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a187d100>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:12.409082 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:12.409348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:12.409616 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] PATH_INFO: `/v3/projects/3abf7ea16acb460aa540631541d80b62` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:12.410794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3abf7ea16acb460aa540631541d80b62)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:12.412688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:12.463265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3abf7ea16acb460aa540631541d80b62', 'request_id': 'req-6f7626f2-2000-4d9d-be50-0fc7a9363207'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.470727 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3abf7ea16acb460aa540631541d80b62', 'request_id': 'req-6f7626f2-2000-4d9d-be50-0fc7a9363207'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.476173 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3abf7ea16acb460aa540631541d80b62', 'request_id': 'req-6f7626f2-2000-4d9d-be50-0fc7a9363207'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.488099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] The token cache is being invalidate because project 3abf7ea16acb460aa540631541d80b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:12.488416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.489552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.491129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1005/2003] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:12 2022] DELETE /identity/v3/projects/3abf7ea16acb460aa540631541d80b62 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:12.495099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:12.497376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:12.510323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be797e-26d0-4b49-b82f-b0ac5049a00a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:12.568650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a14cba60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:12.569772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:12.570121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:12.570408 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] PATH_INFO: `/v3/users/2609dd36fa6844dab021842653351c61` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:12.571553 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2609dd36fa6844dab021842653351c61)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:12.573624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:12.626785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2609dd36fa6844dab021842653351c61'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.627469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2609dd36fa6844dab021842653351c61'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.628073 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2609dd36fa6844dab021842653351c61'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.641910 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2609dd36fa6844dab021842653351c61'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.649691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-34393719-5f04-45cc-971f-cab6fdb86e00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2609dd36fa6844dab021842653351c61'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:12.667389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 999/2004] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:12 2022] DELETE /identity/v3/users/2609dd36fa6844dab021842653351c61 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:13.082065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.083507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:13.103679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7626f2-2000-4d9d-be50-0fc7a9363207 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.182062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=mtI9HeAtSN6kidHju_j4Ig, audit_chain_id=['mtI9HeAtSN6kidHju_j4Ig']) at 0x7fe8a10abcd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.183113 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.183823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.184261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] PATH_INFO: `/v3/projects/3a0a594cf6d049dc95fc8da7542005e0` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.187478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0a594cf6d049dc95fc8da7542005e0)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.189445 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.263167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0a594cf6d049dc95fc8da7542005e0', 'request_id': 'req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:13.274182 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0a594cf6d049dc95fc8da7542005e0', 'request_id': 'req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:13.282493 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0a594cf6d049dc95fc8da7542005e0', 'request_id': 'req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:13.295371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] The token cache is being invalidate because project 3a0a594cf6d049dc95fc8da7542005e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:13.295720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:13.303146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-cf3bd2d4-120c-4651-b2b5-3d217e1b5962 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:13.305147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1006/2005] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:13 2022] DELETE /identity/v3/projects/3a0a594cf6d049dc95fc8da7542005e0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:13.313083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.314569 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.314854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.337037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:13.338702 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:13.433543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1000/2006] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:13.444837 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.445451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.445451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.473663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:13.478042 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:13.503677 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1007/2007] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:13.508419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.527407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf499a71-fb0c-46e0-b8d8-0e511d3d6b2e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.538092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a158d160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.539366 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.539817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.540928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.541855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:13.542339 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.545716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.563139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1001/2008] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:13.564346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.579149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652e8049-185a-409e-99f3-f9deb6e2d6d1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.588773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a103ad00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.589801 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.590350 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.590812 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.591881 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.593929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.625388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1008/2009] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:13 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:13.629684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.644414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b428d1-03e8-4c45-a061-ff5553b48820 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.705610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a14f18e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.706827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.707174 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.707521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.708288 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.710292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.733949 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1002/2010] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:13 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:13.735417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.746531 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c5cad-3f2a-4c87-86c0-101cccf8f779 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.751289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a190be50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.751952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.752249 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.752527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.753277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.754928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.765562 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1009/2011] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:13.769515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.779804 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d7a5ba-e656-490d-bd9b-cc740f19fe92 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.784376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c09592-2fd3-4b83-adb5-98536324b7b7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a153f7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.785078 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09592-2fd3-4b83-adb5-98536324b7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.785341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09592-2fd3-4b83-adb5-98536324b7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.785618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c09592-2fd3-4b83-adb5-98536324b7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.786337 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09592-2fd3-4b83-adb5-98536324b7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.787966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c09592-2fd3-4b83-adb5-98536324b7b7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.802170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1003/2012] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:13.803456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:13.814213 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6387ab1-666e-4d5b-a4ef-90052ba0607a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:13.819296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a0ffb6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:13.820180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.820459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.820734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] PATH_INFO: `/v3/projects/f42916f6495a41fbb82278d020373868/users/754891aa2a6244e097f10a369d9119bd/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.835726 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42916f6495a41fbb82278d020373868, user_id=754891aa2a6244e097f10a369d9119bd, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:13.838480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:13.851721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1010/2013] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:13 2022] PUT /identity/v3/projects/f42916f6495a41fbb82278d020373868/users/754891aa2a6244e097f10a369d9119bd/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:13.865139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:13.865572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:13.865947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:13.895620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] MFA Rules not processed for user `754891aa2a6244e097f10a369d9119bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:13.896919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:13.993447 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1004/2014] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:13.994587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.065744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9237b-c939-4a30-ae10-2a454edc2ef8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.070552 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1819e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.071262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.071546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.071820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.072721 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.074758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.105518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1011/2015] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:13 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:14.111240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.122868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a49d3c6-2424-471f-9b0e-a97c3e8c16d6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.194648 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a19b5160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.195836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.195836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.196168 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.197041 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.199640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.223132 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1005/2016] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:14 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:14.227577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.245102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d25d0-ef33-4331-a9f7-f86840d0a554 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.273077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1579370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.273866 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.274270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.274580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.279058 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.280790 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.295577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1012/2017] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:14.299680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.316050 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b792f-e20e-4163-95de-11d9d5f4f07a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.324400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe990800-90f3-48b7-8dff-c9275308b016 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a15fc280>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.325372 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990800-90f3-48b7-8dff-c9275308b016 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.325805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990800-90f3-48b7-8dff-c9275308b016 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.326263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe990800-90f3-48b7-8dff-c9275308b016 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.327151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe990800-90f3-48b7-8dff-c9275308b016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.329090 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe990800-90f3-48b7-8dff-c9275308b016 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.342371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1006/2018] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:14.354232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.373691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24b69b-d880-4ece-91cb-e3bb49659542 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.387625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a158c460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.388763 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.390949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.391315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] PATH_INFO: `/v3/projects/97c4c02aabae42589d336fd7ed26de2a/users/4f2f7280be10447b914fdb2137bd5d65/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.414217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c4c02aabae42589d336fd7ed26de2a, user_id=4f2f7280be10447b914fdb2137bd5d65, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.416834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.435300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1013/2019] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:14 2022] PUT /identity/v3/projects/97c4c02aabae42589d336fd7ed26de2a/users/4f2f7280be10447b914fdb2137bd5d65/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:14.446264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.446556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.446952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.481793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] MFA Rules not processed for user `4f2f7280be10447b914fdb2137bd5d65`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:14.483107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:14.547066 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1007/2020] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:14.551407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.638473 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.640442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:14.640645 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b1acc-a45f-43b4-8fa0-87d91230aa3c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.645892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a153b820>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.646667 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.647045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.647410 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.648196 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.650406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.658250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154d41aa-268e-41f7-af49-bfecc359f0e5 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.664212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a1557160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.665226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.665506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.665778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] PATH_INFO: `/v3/users/209b2b7ab7b049449f54c60b4f452a0a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.667832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209b2b7ab7b049449f54c60b4f452a0a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.670229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.689556 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1014/2021] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:14 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:14.690875 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.780854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209b2b7ab7b049449f54c60b4f452a0a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:14.782604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209b2b7ab7b049449f54c60b4f452a0a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:14.784074 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209b2b7ab7b049449f54c60b4f452a0a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:14.804068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209b2b7ab7b049449f54c60b4f452a0a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:14.804688 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57502ae3-2483-46b7-893b-a24ceee8f6a5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.810633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a17d1df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.811412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.811679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.812138 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.813871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.816568 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.821548 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8789d6bf-b4ea-4e8e-b157-791c9739d461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209b2b7ab7b049449f54c60b4f452a0a'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:14.844024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1008/2022] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:14 2022] DELETE /identity/v3/users/209b2b7ab7b049449f54c60b4f452a0a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:14.848334 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.849521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.850049 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.869348 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1015/2023] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:14 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:14.870590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.875365 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:14.876629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:14.876966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:14.898690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa12955-d176-49ba-abf2-b8cbe5fc9a88 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:14.985765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1009/2024] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:14.990019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a0f5f3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:14.990943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:14.991429 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:14.992095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:14.993077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:14.994906 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:14.995784 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:14.998538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:15.012497 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1016/2025] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:15.014194 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:15.025563 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182e8fa-47d9-41a6-adcf-c95054b9d1c8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:15.033951 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1811580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:15.034931 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.035311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.035597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] PATH_INFO: `/v3/projects/2f790ca6418c4349b70cd21fe1121216/users/00871b9e2deb49e286b2456851ad0e5e/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.055142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f790ca6418c4349b70cd21fe1121216, user_id=00871b9e2deb49e286b2456851ad0e5e, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:15.057743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:15.074351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1017/2026] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:15 2022] PUT /identity/v3/projects/2f790ca6418c4349b70cd21fe1121216/users/00871b9e2deb49e286b2456851ad0e5e/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:15.079698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:15.082207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ccffc-fc97-4716-8a14-c10b88b67980 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:15.140876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a1a099d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:15.141748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.142058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.142394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.157911 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b47b519-d5b4-4b41-8caf-3aee56d3689d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:15.162687 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1549b80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:15.163352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.163642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.163915 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.164640 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:15.166261 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:15.176766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1018/2027] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:15.180677 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:15.190872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab397e1-8bf2-4007-bc23-7bc2f644ac86 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:15.195417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d82034-625e-41a7-9830-afbeb3e1ebb1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a0f5f3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:15.196296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82034-625e-41a7-9830-afbeb3e1ebb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.196573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82034-625e-41a7-9830-afbeb3e1ebb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.196836 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d82034-625e-41a7-9830-afbeb3e1ebb1 admin admin] PATH_INFO: `/v3/projects/2f790ca6418c4349b70cd21fe1121216/users/00871b9e2deb49e286b2456851ad0e5e/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.199384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82034-625e-41a7-9830-afbeb3e1ebb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f790ca6418c4349b70cd21fe1121216, user_id=00871b9e2deb49e286b2456851ad0e5e, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:15.202003 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d82034-625e-41a7-9830-afbeb3e1ebb1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:15.204100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:15.205683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:15.212009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1019/2028] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:15 2022] PUT /identity/v3/projects/2f790ca6418c4349b70cd21fe1121216/users/00871b9e2deb49e286b2456851ad0e5e/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:15.216065 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1010/2029] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:15.223400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.223689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.223963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.251602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] MFA Rules not processed for user `00871b9e2deb49e286b2456851ad0e5e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:15.252811 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:15.328805 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1020/2030] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:15.341003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:15.342450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:15.436060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeac9d2-ea8d-4c6d-a4a1-1321208a2445 service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:15.500670 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a19bff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:15.501527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.501998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.502292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.504254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:15.583879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:15.586369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26f63bc-8066-4be5-8eeb-cb41aa36e5fc service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:15.598583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1011/2031] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:15.629902 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:15.631655 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:15.776148 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeab38-1d2c-4d91-8110-9c7a1c7839b3 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:15.782578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=lwmN8beNSWWFEE2mxJ0axg, audit_chain_id=['lwmN8beNSWWFEE2mxJ0axg']) at 0x7fe8a182c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:15.799730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.799730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.799730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] PATH_INFO: `/v3/projects/0283e67e6a744080acf3ebf8d34a2c97` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.803443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0283e67e6a744080acf3ebf8d34a2c97)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:15.805386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:15.865296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0283e67e6a744080acf3ebf8d34a2c97', 'request_id': 'req-41e390e5-c231-4728-9cdb-5f69fcdb288d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:15.874488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0283e67e6a744080acf3ebf8d34a2c97', 'request_id': 'req-41e390e5-c231-4728-9cdb-5f69fcdb288d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:15.881170 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0283e67e6a744080acf3ebf8d34a2c97', 'request_id': 'req-41e390e5-c231-4728-9cdb-5f69fcdb288d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:15.893091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] The token cache is being invalidate because project 0283e67e6a744080acf3ebf8d34a2c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:15.893370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:15.894034 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-41e390e5-c231-4728-9cdb-5f69fcdb288d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:15.896175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1021/2032] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:15 2022] DELETE /identity/v3/projects/0283e67e6a744080acf3ebf8d34a2c97 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:15.902561 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:15.902881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:15.903141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:15.923275 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:15.924616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:16.006091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1012/2033] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:16.014518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.015285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.015639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.040579 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:16.041892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:16.052476 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1022/2034] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:16.057326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.069162 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90049145-187d-4047-b2d6-31919ec01de2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.075484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a15739d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.076196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.076480 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.076759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.077534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:16.077846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.079492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.092547 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1013/2035] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:16.096867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.108107 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada37dc-4ac5-456e-b97b-bc7990d1b966 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.114331 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a0fe5c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.115020 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.115449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.115755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.116691 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.118903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.168118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1023/2036] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:16 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:16.169425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.182650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bb4af6-3e3d-4d4d-b9bb-74eba936e201 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.267036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a14ead00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.268264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.268754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.269442 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.270891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.273200 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.306105 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1014/2037] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:16 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:16.310312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.321858 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0a49b-d175-4cea-a16b-c2f6ca97dd72 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.328299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a0ffbee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.329330 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.330008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.330485 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.331419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.333358 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.347723 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1024/2038] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:16.352034 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.367471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df55241-73f1-499f-ad8d-956af6845628 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.378507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd41a26f-42cb-47dd-bb40-b4572a88a925 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a15860a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.379196 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a26f-42cb-47dd-bb40-b4572a88a925 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.379478 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a26f-42cb-47dd-bb40-b4572a88a925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.379752 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd41a26f-42cb-47dd-bb40-b4572a88a925 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.383018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41a26f-42cb-47dd-bb40-b4572a88a925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.385017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd41a26f-42cb-47dd-bb40-b4572a88a925 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.398717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1015/2039] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:16.403373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.452706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b2a41-15b7-497f-bc3b-ce4a57f57c4a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.471843 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a0ffb6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.473184 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.474690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.476068 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] PATH_INFO: `/v3/projects/cc9b556047354e45b6ca430f669b759c/users/49d940413a62480191cf53f10148d5fa/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.530748 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc9b556047354e45b6ca430f669b759c, user_id=49d940413a62480191cf53f10148d5fa, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.539578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.592130 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1025/2040] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:16 2022] PUT /identity/v3/projects/cc9b556047354e45b6ca430f669b759c/users/49d940413a62480191cf53f10148d5fa/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:16.603217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.603554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.603782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.661854 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] MFA Rules not processed for user `49d940413a62480191cf53f10148d5fa`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:16.663139 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:16.755068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1016/2041] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:16.766432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:16.768391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:16.846573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7009-cfff-43e7-bd28-afb1e5fc9cb7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:16.851111 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a0fe5f40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:16.851962 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:16.852403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:16.852834 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:16.867062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:16.868569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:16.880038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1026/2042] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:17.416053 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:17.435563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5054afe3-91e0-4262-9a59-7fe7b02d2d2f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:17.439197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a158d700>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:17.440048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:17.440326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:17.440592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:17.442757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:17.519166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:17.520779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:17.532175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1017/2043] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:18.377265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:18.379253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:18.395806 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187b63e-be7c-454f-9fb1-d76f9f3a6b4e service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:18.412636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1831790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:18.413548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:18.415670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:18.416108 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:18.421992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:18.574200 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:18.575968 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:18.607959 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1027/2044] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:21.794279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:21.795919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:21.902425 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eb91e-8760-4f63-9806-16d513968621 service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:21.907781 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a19a84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:21.908948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:21.909291 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:21.909982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] PATH_INFO: `/v3/users/22c3a5954375451c9771c95102e8b783` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:21.911404 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=22c3a5954375451c9771c95102e8b783)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:21.913676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:22.028297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22c3a5954375451c9771c95102e8b783'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.029390 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22c3a5954375451c9771c95102e8b783'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.030142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22c3a5954375451c9771c95102e8b783'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.054363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22c3a5954375451c9771c95102e8b783'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.067341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22c3a5954375451c9771c95102e8b783'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.094075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1018/2045] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:21 2022] DELETE /identity/v3/users/22c3a5954375451c9771c95102e8b783 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:22.379084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:22.401167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66f86e-607a-49ea-a67d-78be56f78ec4 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:22.518752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a18c5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:22.519622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:22.519944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:22.520217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] PATH_INFO: `/v3/projects/88dc8239c33a43a0b8f88053e88b6370` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:22.525519 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=88dc8239c33a43a0b8f88053e88b6370)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:22.530056 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:22.613503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88dc8239c33a43a0b8f88053e88b6370', 'request_id': 'req-3759e22d-3a22-4891-8cbf-317796426c9d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.625505 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88dc8239c33a43a0b8f88053e88b6370', 'request_id': 'req-3759e22d-3a22-4891-8cbf-317796426c9d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.635936 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88dc8239c33a43a0b8f88053e88b6370', 'request_id': 'req-3759e22d-3a22-4891-8cbf-317796426c9d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.653823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] The token cache is being invalidate because project 88dc8239c33a43a0b8f88053e88b6370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:22.654435 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.655295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.657528 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1028/2046] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:22 2022] DELETE /identity/v3/projects/88dc8239c33a43a0b8f88053e88b6370 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:22.661045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:22.661651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:22.662479 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:22.663371 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:22.681426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85c22c-5e8f-404b-905d-5deb91c7e9cf admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:22.763650 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a199b460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:22.764456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:22.764741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:22.765037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] PATH_INFO: `/v3/users/754891aa2a6244e097f10a369d9119bd` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:22.766538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=754891aa2a6244e097f10a369d9119bd)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:22.768894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:22.773440 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3759e22d-3a22-4891-8cbf-317796426c9d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:22.796966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a182b310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:22.800047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:22.800532 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:22.800971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] PATH_INFO: `/v3/users/945f2526901a4d1b883ef95631a5c795` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:22.802752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=945f2526901a4d1b883ef95631a5c795)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:22.812538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:22.828503 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754891aa2a6244e097f10a369d9119bd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.829933 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754891aa2a6244e097f10a369d9119bd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.831808 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754891aa2a6244e097f10a369d9119bd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.847709 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754891aa2a6244e097f10a369d9119bd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.860789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fb683e1c-bb9f-4c04-8e32-f5a91e82fb9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754891aa2a6244e097f10a369d9119bd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.885247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1019/2047] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:22 2022] DELETE /identity/v3/users/754891aa2a6244e097f10a369d9119bd => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:22.887713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:22.888063 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:22.888587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:22.921515 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:22.923013 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:22.924707 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945f2526901a4d1b883ef95631a5c795'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.925862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945f2526901a4d1b883ef95631a5c795'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.935340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945f2526901a4d1b883ef95631a5c795'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.974581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945f2526901a4d1b883ef95631a5c795'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:22.992163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945f2526901a4d1b883ef95631a5c795'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.015277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1029/2048] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:22 2022] DELETE /identity/v3/users/945f2526901a4d1b883ef95631a5c795 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:23.050696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1020/2049] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:23.057289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.059060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:23.128629 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ff28-ccb1-43aa-9482-437bce7148e2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.133527 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4258b760-ff11-4a21-8609-6a99bc766f0a service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a155fdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.134171 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b760-ff11-4a21-8609-6a99bc766f0a service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.134781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b760-ff11-4a21-8609-6a99bc766f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.135162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4258b760-ff11-4a21-8609-6a99bc766f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.208407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258b760-ff11-4a21-8609-6a99bc766f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.211683 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4258b760-ff11-4a21-8609-6a99bc766f0a service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.223718 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1030/2050] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:23.250911 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.252351 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:23.264944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be009f5-c8ea-4389-a653-1f805393dc3f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.270169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=iM1AfKnUQV2A3h-ZtyMIaQ, audit_chain_id=['iM1AfKnUQV2A3h-ZtyMIaQ']) at 0x7fe8a15618b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.271513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.271960 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.272410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] PATH_INFO: `/v3/projects/5137506c1663449db67a8ef895d4bfa2` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.273726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5137506c1663449db67a8ef895d4bfa2)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.276258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.343468 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5137506c1663449db67a8ef895d4bfa2', 'request_id': 'req-f6d733e6-6e33-4c0c-98b8-abf028f0e507'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.359258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5137506c1663449db67a8ef895d4bfa2', 'request_id': 'req-f6d733e6-6e33-4c0c-98b8-abf028f0e507'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.367382 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5137506c1663449db67a8ef895d4bfa2', 'request_id': 'req-f6d733e6-6e33-4c0c-98b8-abf028f0e507'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.392165 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] The token cache is being invalidate because project 5137506c1663449db67a8ef895d4bfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:23.392459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.393211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f6d733e6-6e33-4c0c-98b8-abf028f0e507 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.397077 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1021/2051] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:23 2022] DELETE /identity/v3/projects/5137506c1663449db67a8ef895d4bfa2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:23.402494 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.403578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.404180 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.463123 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:23.464580 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:23.544637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1031/2052] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:23.552739 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.553486 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.553950 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.579932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:23.581690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:23.595117 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1022/2053] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:23.595869 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.608903 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f49286-bbef-4f2e-8059-0a802fb0b098 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.624136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a151dd00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.624823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.625127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.625746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.626492 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:23.626803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.628420 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.651269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1032/2054] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:23.656107 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.665927 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32470e9c-2b85-4a0a-aa08-c5fcfaf0be98 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.685785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a14f4070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.686629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.687024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.687307 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.688212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.691459 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.733069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.733279 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1023/2055] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:23 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:23.733401 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:23.734161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.750581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e29d0-22e1-421d-8cbf-c37e07a49086 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.831538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32b8eae-b220-47c5-956d-c62b6363ad3a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.843760 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a19a32b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.844620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.844969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.845530 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.846559 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.848737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.853904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1532310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.855856 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.856212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.856614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] PATH_INFO: `/v3/projects/f42916f6495a41fbb82278d020373868` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.858133 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42916f6495a41fbb82278d020373868)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.860218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.877778 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1024/2056] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:23 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:23.881818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.894570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e523c2-41ae-48f9-90df-32edd3bddb0a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.900038 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a1575c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:23.901267 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:23.902294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:23.902815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:23.903695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:23.905868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:23.931613 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42916f6495a41fbb82278d020373868', 'request_id': 'req-33703636-b8d2-4576-99e9-1e2959937031'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.936953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1025/2057] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:23.940438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.944177 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42916f6495a41fbb82278d020373868', 'request_id': 'req-33703636-b8d2-4576-99e9-1e2959937031'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.952899 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42916f6495a41fbb82278d020373868', 'request_id': 'req-33703636-b8d2-4576-99e9-1e2959937031'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.967671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ee1768-f049-4264-bfc1-3970cb504ab6 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:23.987301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] The token cache is being invalidate because project f42916f6495a41fbb82278d020373868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:23.987860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.988704 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:23.991538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1033/2058] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:23 2022] DELETE /identity/v3/projects/f42916f6495a41fbb82278d020373868 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:23.996338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:23.999155 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:24.085619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a10f5550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:24.086620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:24.088369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:24.088852 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:24.090962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:24.093214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:24.109264 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1026/2059] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:23 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:24.122471 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:24.124328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:24.128946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33703636-b8d2-4576-99e9-1e2959937031 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:24.145028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1811580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:24.148365 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:24.149218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:24.149759 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] PATH_INFO: `/v3/users/4f2f7280be10447b914fdb2137bd5d65` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:24.153293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2f7280be10447b914fdb2137bd5d65)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:24.157543 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:24.164068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d2fdd-7cd4-4da7-b220-76056c1f233c admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:24.179485 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eaeaf1-e0f1-4de5-9a49-5f1086da621e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a1143850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:24.180771 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaeaf1-e0f1-4de5-9a49-5f1086da621e admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:24.182244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaeaf1-e0f1-4de5-9a49-5f1086da621e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:24.183283 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eaeaf1-e0f1-4de5-9a49-5f1086da621e admin admin] PATH_INFO: `/v3/projects/6e1959e4537e4c709bf1624d7755b366/users/eb1de6a2b372467a8d3179ec46db44d0/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:24.217104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaeaf1-e0f1-4de5-9a49-5f1086da621e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1959e4537e4c709bf1624d7755b366, user_id=eb1de6a2b372467a8d3179ec46db44d0, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:24.219802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eaeaf1-e0f1-4de5-9a49-5f1086da621e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:24.242776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1027/2060] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:24 2022] PUT /identity/v3/projects/6e1959e4537e4c709bf1624d7755b366/users/eb1de6a2b372467a8d3179ec46db44d0/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:24.253413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2f7280be10447b914fdb2137bd5d65'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.253694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:24.253989 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:24.254265 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:24.254502 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2f7280be10447b914fdb2137bd5d65'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.255191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2f7280be10447b914fdb2137bd5d65'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.272151 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2f7280be10447b914fdb2137bd5d65'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.289486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2f7280be10447b914fdb2137bd5d65'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.300222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] MFA Rules not processed for user `eb1de6a2b372467a8d3179ec46db44d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:24.301521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:24.311385 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1034/2061] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:23 2022] DELETE /identity/v3/users/4f2f7280be10447b914fdb2137bd5d65 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:24.461481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1028/2062] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:24.472896 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:24.474483 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:24.559228 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7dc903-3360-4481-9d00-8171c705694d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:24.564086 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1096490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:24.564744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:24.565322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:24.565612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:24.627455 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:24.629238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:24.640958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1035/2063] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:24.655142 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:24.656685 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:24.747819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f40d4b-f161-43cc-9269-c75e5b7ad3e9 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:24.807346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a183fd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:24.809052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:24.809410 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:24.809624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] PATH_INFO: `/v3/projects/97c4c02aabae42589d336fd7ed26de2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:24.810841 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c4c02aabae42589d336fd7ed26de2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:24.812737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:24.868341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c4c02aabae42589d336fd7ed26de2a', 'request_id': 'req-702efe01-60a9-44f0-8ace-ebaee70ecbde'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.879912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c4c02aabae42589d336fd7ed26de2a', 'request_id': 'req-702efe01-60a9-44f0-8ace-ebaee70ecbde'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.889018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c4c02aabae42589d336fd7ed26de2a', 'request_id': 'req-702efe01-60a9-44f0-8ace-ebaee70ecbde'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.902455 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] The token cache is being invalidate because project 97c4c02aabae42589d336fd7ed26de2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:24.902912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.903926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:24.912600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1029/2064] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:24 2022] DELETE /identity/v3/projects/97c4c02aabae42589d336fd7ed26de2a => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:24.912714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:24.936698 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115f8b6-7803-4ec3-89eb-f5e01c8e4e84 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.064582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a1541bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.065472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.065750 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.066023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] PATH_INFO: `/v3/users/00871b9e2deb49e286b2456851ad0e5e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.067231 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00871b9e2deb49e286b2456851ad0e5e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.069362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.122057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00871b9e2deb49e286b2456851ad0e5e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.122699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00871b9e2deb49e286b2456851ad0e5e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.123304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00871b9e2deb49e286b2456851ad0e5e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.135379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00871b9e2deb49e286b2456851ad0e5e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.143448 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8d744e5-08a5-4a6c-b936-03ef678cc0c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00871b9e2deb49e286b2456851ad0e5e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.155849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1036/2065] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:24 2022] DELETE /identity/v3/users/00871b9e2deb49e286b2456851ad0e5e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:25.413817 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.415292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:25.428535 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702efe01-60a9-44f0-8ace-ebaee70ecbde admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.494772 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=rrglVCpzRaWI8A_Ztmhqbg, audit_chain_id=['rrglVCpzRaWI8A_Ztmhqbg']) at 0x7fe8a14d19a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.495833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.496122 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.496400 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] PATH_INFO: `/v3/projects/2f790ca6418c4349b70cd21fe1121216` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.497620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f790ca6418c4349b70cd21fe1121216)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.500075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.549901 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f790ca6418c4349b70cd21fe1121216', 'request_id': 'req-fabaf142-f249-45dc-a3a6-e14499ff1bcc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.556884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f790ca6418c4349b70cd21fe1121216', 'request_id': 'req-fabaf142-f249-45dc-a3a6-e14499ff1bcc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.562616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f790ca6418c4349b70cd21fe1121216', 'request_id': 'req-fabaf142-f249-45dc-a3a6-e14499ff1bcc'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.573356 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] The token cache is being invalidate because project 2f790ca6418c4349b70cd21fe1121216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:25.573667 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.574298 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-fabaf142-f249-45dc-a3a6-e14499ff1bcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:25.575834 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1030/2066] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:25 2022] DELETE /identity/v3/projects/2f790ca6418c4349b70cd21fe1121216 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:25.580789 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.581295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.581384 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.599128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:25.600256 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:25.657538 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1037/2067] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:25.665414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.665698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.665968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.684824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:25.686048 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:25.693892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1031/2068] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:25.698004 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.707786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9a8be-ff2e-4c53-b3e4-fb760e94d0cf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.712414 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a1429af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.713104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.713388 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.713663 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.715432 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:25.715749 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.717430 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.728784 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1038/2069] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:25.733775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.742940 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeca41-2bfe-4fae-a02c-473c6e8e9618 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.748033 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a19a84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.748673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.748954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.749255 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.749942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.751824 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.778521 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1032/2070] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:25 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:25.782722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.792537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b813d-5c8d-4bd6-af8a-69f6cdf57319 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.845759 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a1096c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.846411 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.846686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.846953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.847642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.849619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.867404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1039/2071] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:25 2022] POST /identity/v3/users => generated 285 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:25.871586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.881766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c492793-4235-4fe7-b4e1-1e8aa00568ad admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.887022 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a1122190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.887740 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.888017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.888287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.889037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.890614 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.900765 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1033/2072] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:25.905590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.915174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef180a-0976-4fc6-a3dd-8389b70802fd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.919771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b84154-c577-49b2-9627-156d4f0c8db2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a182c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.920407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84154-c577-49b2-9627-156d4f0c8db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.920685 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84154-c577-49b2-9627-156d4f0c8db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.920955 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b84154-c577-49b2-9627-156d4f0c8db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.921708 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84154-c577-49b2-9627-156d4f0c8db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.923270 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b84154-c577-49b2-9627-156d4f0c8db2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.933722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1040/2073] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:25.937694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:25.947682 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45de6-6518-4227-b71c-502e02c67c76 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:25.952930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a1517790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:25.953814 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.954093 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.954363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] PATH_INFO: `/v3/projects/b43aaa1fe2b74a9a9bb27ff1cf18c4a1/users/4010456427774af0a07185735b5ceb97/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:25.972519 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b43aaa1fe2b74a9a9bb27ff1cf18c4a1, user_id=4010456427774af0a07185735b5ceb97, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:25.975184 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:25.987969 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1034/2074] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:25 2022] PUT /identity/v3/projects/b43aaa1fe2b74a9a9bb27ff1cf18c4a1/users/4010456427774af0a07185735b5ceb97/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:25.998285 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:25.998573 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:25.998849 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:26.024450 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] MFA Rules not processed for user `4010456427774af0a07185735b5ceb97`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:26.025668 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:26.095364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1041/2075] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:26.106988 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:26.108777 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:26.167669 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fbd89e-10c5-4cfc-80b7-da22adf87754 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:26.172926 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95887a-2ac7-43c2-9de2-01eedeed02d7 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=0xCk5xx_QBygXVCd79_-Lw, audit_chain_id=['0xCk5xx_QBygXVCd79_-Lw']) at 0x7fe8a1464af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296ed9d38ea741b1bc2c72fc398b5009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:26.173672 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95887a-2ac7-43c2-9de2-01eedeed02d7 service glance] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:26.174024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95887a-2ac7-43c2-9de2-01eedeed02d7 service glance] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:26.174856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95887a-2ac7-43c2-9de2-01eedeed02d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:26.189321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95887a-2ac7-43c2-9de2-01eedeed02d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:26.190888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95887a-2ac7-43c2-9de2-01eedeed02d7 service glance] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:26.201144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1035/2076] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:38.932929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:38.934728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.023498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bf863-92e9-4555-9aea-7dd6f4f24898 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:39.032304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a1523a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:39.032304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.032304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.032304 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] PATH_INFO: `/v3/users/49d940413a62480191cf53f10148d5fa` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.033597 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] RBAC: Authorizing `identity:delete_user(user_id=49d940413a62480191cf53f10148d5fa)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:39.035607 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:39.090312 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49d940413a62480191cf53f10148d5fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.090967 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49d940413a62480191cf53f10148d5fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.091565 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49d940413a62480191cf53f10148d5fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.108239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49d940413a62480191cf53f10148d5fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.115876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49d940413a62480191cf53f10148d5fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.128702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1042/2077] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:38 2022] DELETE /identity/v3/users/49d940413a62480191cf53f10148d5fa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:39.133328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.133818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.134079 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.154993 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:39.156722 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.223438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1036/2078] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:39.233651 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:39.235381 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.299431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a38fab7-5d98-445a-bb03-94ceb9b3277f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:39.303247 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a131f460>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:39.304081 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.304341 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.304679 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.316715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:39.318190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:39.327745 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:39.329831 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.331316 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1043/2079] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:39.356100 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a0ce1-cf76-41ba-ae32-387f4d35e509 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:39.361481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a10e1ca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:39.362360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.362637 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.362904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] PATH_INFO: `/v3/users/5cbe87047c574127861cf1e4944c0fff` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.364335 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbe87047c574127861cf1e4944c0fff)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:39.366520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:39.416943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbe87047c574127861cf1e4944c0fff'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.418229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbe87047c574127861cf1e4944c0fff'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.418884 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbe87047c574127861cf1e4944c0fff'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.431148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbe87047c574127861cf1e4944c0fff'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.440246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40909a69-499e-4553-8d94-17a53f0b558f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbe87047c574127861cf1e4944c0fff'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.454194 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1037/2080] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:39 2022] DELETE /identity/v3/users/5cbe87047c574127861cf1e4944c0fff => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:39.486702 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:39.488163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.510195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba317f91-5aa0-4a4e-867f-448b6aaad8ca service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:39.571551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a1833cd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:39.572454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.572728 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.573047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] PATH_INFO: `/v3/users/eb1de6a2b372467a8d3179ec46db44d0` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.574345 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb1de6a2b372467a8d3179ec46db44d0)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:39.577863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:39.625886 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb1de6a2b372467a8d3179ec46db44d0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.626469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb1de6a2b372467a8d3179ec46db44d0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.627100 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb1de6a2b372467a8d3179ec46db44d0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.642786 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb1de6a2b372467a8d3179ec46db44d0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.651286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb1de6a2b372467a8d3179ec46db44d0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.668267 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1044/2081] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:39 2022] DELETE /identity/v3/users/eb1de6a2b372467a8d3179ec46db44d0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:39.674270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.674566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.675691 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.703130 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:39.704812 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.739355 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:39.740776 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.805363 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1038/2082] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:39.806346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:39.807671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.824153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c690f74-2d71-4f17-be90-fd962802530a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:39.830073 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=91RWHJvMTje1tRV35HVJHQ, audit_chain_id=['91RWHJvMTje1tRV35HVJHQ']) at 0x7fe8a1464970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:39.830931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.831210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.831481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] PATH_INFO: `/v3/projects/612784cc2dcc45b1b71ec19fc213f48f` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.834087 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=612784cc2dcc45b1b71ec19fc213f48f)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:39.839797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:39.852682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede315b6-9046-4eec-928d-77ac7e15a472 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:39.858132 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NPU068WdR-yHS7FixNAGHQ, audit_chain_id=['NPU068WdR-yHS7FixNAGHQ']) at 0x7fe8a18682e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:39.860892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.860892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.860892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] PATH_INFO: `/v3/projects/cc9b556047354e45b6ca430f669b759c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:39.860892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc9b556047354e45b6ca430f669b759c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:39.862703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:39.918517 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc9b556047354e45b6ca430f669b759c', 'request_id': 'req-a55db8d8-de9e-4065-af4f-775aba3f027c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.927518 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc9b556047354e45b6ca430f669b759c', 'request_id': 'req-a55db8d8-de9e-4065-af4f-775aba3f027c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.927726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612784cc2dcc45b1b71ec19fc213f48f', 'request_id': 'req-695d329e-b3c9-4401-a5cc-5d2a395a0262'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.939068 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612784cc2dcc45b1b71ec19fc213f48f', 'request_id': 'req-695d329e-b3c9-4401-a5cc-5d2a395a0262'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.939266 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc9b556047354e45b6ca430f669b759c', 'request_id': 'req-a55db8d8-de9e-4065-af4f-775aba3f027c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.952759 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612784cc2dcc45b1b71ec19fc213f48f', 'request_id': 'req-695d329e-b3c9-4401-a5cc-5d2a395a0262'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.960029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] The token cache is being invalidate because project cc9b556047354e45b6ca430f669b759c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:39.960029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.960029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.961218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1045/2083] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:39 2022] DELETE /identity/v3/projects/cc9b556047354e45b6ca430f669b759c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:39.962362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:39.964019 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:39.974316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] The token cache is being invalidate because project 612784cc2dcc45b1b71ec19fc213f48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:39.974627 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.975436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-695d329e-b3c9-4401-a5cc-5d2a395a0262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:39.979885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1039/2084] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:39 2022] DELETE /identity/v3/projects/612784cc2dcc45b1b71ec19fc213f48f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:39.985745 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f121-7ef4-43ca-a192-215cd08d739b None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:39.986082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f121-7ef4-43ca-a192-215cd08d739b None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:39.986367 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f121-7ef4-43ca-a192-215cd08d739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.038177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-e721f121-7ef4-43ca-a192-215cd08d739b None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:40.039957 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-e721f121-7ef4-43ca-a192-215cd08d739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.054073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55db8d8-de9e-4065-af4f-775aba3f027c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.058166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1429af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.058832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.059108 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.059376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.061666 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.165541 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1040/2085] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:40.177742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.178227 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.178690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.179126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.180303 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.194817 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1046/2086] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:40.202208 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:40.203538 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.211511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1041/2087] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:40.216053 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.226826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4c21a-e4eb-43ad-849c-57bde10f6e15 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.231782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9Cj3mqiRqy-fZ7BDKk1_Q, audit_chain_id=['l9Cj3mqiRqy-fZ7BDKk1_Q']) at 0x7fe8a0fe5c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.232478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.233454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.233706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.234537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:40.235108 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.237078 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.252337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1047/2088] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:40.257461 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.268110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508263c-1304-4f58-8350-961de0f056c4 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.273303 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9Cj3mqiRqy-fZ7BDKk1_Q, audit_chain_id=['l9Cj3mqiRqy-fZ7BDKk1_Q']) at 0x7fe8a1517790>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.274148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.274405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.274684 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.275403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.277886 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.309015 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1042/2089] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:40.312097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.322340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02f579-df17-4ae9-8e54-ed8302557c77 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.402265 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9Cj3mqiRqy-fZ7BDKk1_Q, audit_chain_id=['l9Cj3mqiRqy-fZ7BDKk1_Q']) at 0x7fe8a1096c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.403221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.403590 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.404038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.405571 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.407665 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.432193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1048/2090] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:40.433158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.443791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f680929-32c2-42b0-8fe0-048473f6f167 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.448583 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9Cj3mqiRqy-fZ7BDKk1_Q, audit_chain_id=['l9Cj3mqiRqy-fZ7BDKk1_Q']) at 0x7fe8a160eaf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.449280 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.449562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.449835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.450567 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.452399 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.463141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1043/2091] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:40.467898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.479443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b146-ad7c-436e-b7de-a778bfc62ffd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.483632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.484758 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9Cj3mqiRqy-fZ7BDKk1_Q, audit_chain_id=['l9Cj3mqiRqy-fZ7BDKk1_Q']) at 0x7fe8a180ca30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.485442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.485618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.485733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.485992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.486767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.488364 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.499738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb648c4-e53a-4243-956a-4461198c3089 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.504546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1049/2092] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:40.505632 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.510181 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=5wF3pR9xSeCQCfQyfZ-1pA, audit_chain_id=['5wF3pR9xSeCQCfQyfZ-1pA']) at 0x7fe8a1557160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.511172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.511523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.511803 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] PATH_INFO: `/v3/projects/6e1959e4537e4c709bf1624d7755b366` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.513325 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1959e4537e4c709bf1624d7755b366)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.515973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.516473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e511f1-ceed-4fae-97f6-adf068ea734e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.521700 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d8e5ce-d5a3-4daa-88f7-a680ba528790 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=l9Cj3mqiRqy-fZ7BDKk1_Q, audit_chain_id=['l9Cj3mqiRqy-fZ7BDKk1_Q']) at 0x7fe8a1541f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.522583 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8e5ce-d5a3-4daa-88f7-a680ba528790 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.522877 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8e5ce-d5a3-4daa-88f7-a680ba528790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.523175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d8e5ce-d5a3-4daa-88f7-a680ba528790 admin admin] PATH_INFO: `/v3/projects/a8e091db3cd14ecb9c40257451cd434d/users/88bc7138e3d5438b9a96744e22add357/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.540373 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8e5ce-d5a3-4daa-88f7-a680ba528790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e091db3cd14ecb9c40257451cd434d, user_id=88bc7138e3d5438b9a96744e22add357, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.543089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d8e5ce-d5a3-4daa-88f7-a680ba528790 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.557386 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1050/2093] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:40 2022] PUT /identity/v3/projects/a8e091db3cd14ecb9c40257451cd434d/users/88bc7138e3d5438b9a96744e22add357/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:40.562965 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.563288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.563555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.572384 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1959e4537e4c709bf1624d7755b366', 'request_id': 'req-9b2da36b-2460-4b5f-aa45-2618691a3be9'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:40.580975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:40.581620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1959e4537e4c709bf1624d7755b366', 'request_id': 'req-9b2da36b-2460-4b5f-aa45-2618691a3be9'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:40.582240 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.587801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1959e4537e4c709bf1624d7755b366', 'request_id': 'req-9b2da36b-2460-4b5f-aa45-2618691a3be9'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:40.599700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] The token cache is being invalidate because project 6e1959e4537e4c709bf1624d7755b366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:40.600060 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:40.600718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-9b2da36b-2460-4b5f-aa45-2618691a3be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:40.604662 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1044/2094] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:40 2022] DELETE /identity/v3/projects/6e1959e4537e4c709bf1624d7755b366 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:40.610737 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417302-e902-497d-9989-865b2712a234 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.611018 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417302-e902-497d-9989-865b2712a234 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.611290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92417302-e902-497d-9989-865b2712a234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.629506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-92417302-e902-497d-9989-865b2712a234 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:40.630712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-92417302-e902-497d-9989-865b2712a234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.644417 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1051/2095] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:40.654279 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.656245 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.692395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1045/2096] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:40.700137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.700420 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.700690 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.712431 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47e046-ccd3-4bbb-9009-56155e5854a7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.716117 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a155fdf0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.716765 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.717623 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.717928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.720661 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:40.721912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:40.727612 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.729062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.730229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1046/2097] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:55:40.734575 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.739343 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1052/2098] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:40.745167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c2496-40cb-41a2-94a8-562e74376b9f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.750819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a19b5160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.751500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.751782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.752058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.752802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:40.753148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.754749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.767776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1047/2099] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 13 12:55:40.772018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.783551 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d5d824-7971-4482-bcc4-c2a43f1bc104 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.788486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a18455e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.789391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.789669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.790018 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.792516 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.792792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.821099 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1053/2100] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:40.825304 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.836723 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f2e603-9f45-4d27-9b59-539292ab2a77 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.895741 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a1c72fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.896414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.896693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.896968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.897689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.899654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.931458 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1048/2101] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:40 2022] POST /identity/v3/users => generated 286 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:40.932972 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.945656 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468def2b-59e3-426f-b87e-1e9d4435b198 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.950826 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a1532310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.952185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.952474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.952755 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.953550 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.955425 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:40.970175 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1054/2102] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:40.974247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:40.986665 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2db056-7967-4156-ad79-f86a8642ee27 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:40.992077 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2f648-7cdb-4cdf-90b9-d55a54a5820a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a19a84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:40.992848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2f648-7cdb-4cdf-90b9-d55a54a5820a admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:40.993173 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2f648-7cdb-4cdf-90b9-d55a54a5820a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:40.994099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2f648-7cdb-4cdf-90b9-d55a54a5820a admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:40.994421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2f648-7cdb-4cdf-90b9-d55a54a5820a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:40.996136 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c2f648-7cdb-4cdf-90b9-d55a54a5820a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:41.007116 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1049/2103] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:41.011642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:41.023368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2281796-72fa-4f13-8fbc-f1d6a3c2a579 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:41.032077 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a14fb7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:41.033283 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:41.033570 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:41.033844 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] PATH_INFO: `/v3/projects/5d20cbb46b014b0aa2b6266d64820a66/users/1ce7eb18817649f2861d968683488cf7/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:41.053730 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d20cbb46b014b0aa2b6266d64820a66, user_id=1ce7eb18817649f2861d968683488cf7, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:41.060401 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:41.086272 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1055/2104] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:41 2022] PUT /identity/v3/projects/5d20cbb46b014b0aa2b6266d64820a66/users/1ce7eb18817649f2861d968683488cf7/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:41.098651 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d73b36-f7ef-4715-94b0-28559ca6a7e7 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:41.099416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d73b36-f7ef-4715-94b0-28559ca6a7e7 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:41.099754 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d73b36-f7ef-4715-94b0-28559ca6a7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:41.134736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c3d73b36-f7ef-4715-94b0-28559ca6a7e7 None None] MFA Rules not processed for user `1ce7eb18817649f2861d968683488cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:41.135980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c3d73b36-f7ef-4715-94b0-28559ca6a7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:41.273225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1050/2105] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:41.299778 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:41.302512 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:41.382910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ea722-9522-4113-b6aa-597a21598c57 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:41.386649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] RBAC: auth_context: {'token': <TokenModel (audit_id=g_C7-r29Sf-wds4KLJUeQw, audit_chain_id=['g_C7-r29Sf-wds4KLJUeQw']) at 0x7fe8a0f722b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '296ed9d38ea741b1bc2c72fc398b5009', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:41.387442 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:41.387795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:41.388188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:41.398635 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:41.400258 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:41.434319 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1056/2106] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:45.457153 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f5ffd-0f1a-4b5c-a9f4-b13ea84b52c4 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:45.457606 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f5ffd-0f1a-4b5c-a9f4-b13ea84b52c4 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:45.457695 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f5ffd-0f1a-4b5c-a9f4-b13ea84b52c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:45.489948 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0c3f5ffd-0f1a-4b5c-a9f4-b13ea84b52c4 None None] MFA Rules not processed for user `88bc7138e3d5438b9a96744e22add357`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:45.491281 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0c3f5ffd-0f1a-4b5c-a9f4-b13ea84b52c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:45.565161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1051/2107] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:45.573273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:45.574713 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:45.649628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84d6d6-398d-4fcd-ad22-2cce871007d6 service glance] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:45.655658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] RBAC: auth_context: {'token': <TokenModel (audit_id=WXCHqpg1TouWC97W_DBeTQ, audit_chain_id=['WXCHqpg1TouWC97W_DBeTQ']) at 0x7fe8a1523a90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97df92a4d0e543f79e611b9bfd03e1c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service', 'ResellerAdmin', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:45.656317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:45.656591 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:45.656862 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:45.665969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:45.667592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:45.678559 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1057/2108] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:47.147693 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1e961-5525-45e5-a7fe-b9b309e081f8 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:47.148226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1e961-5525-45e5-a7fe-b9b309e081f8 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:47.148226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1e961-5525-45e5-a7fe-b9b309e081f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:47.169205 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-63f1e961-5525-45e5-a7fe-b9b309e081f8 None None] MFA Rules not processed for user `88bc7138e3d5438b9a96744e22add357`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:47.171580 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-63f1e961-5525-45e5-a7fe-b9b309e081f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:47.180571 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1052/2109] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:50.319398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:50.320883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:50.387306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466fca4-632b-4d2e-8214-1d4dd533c907 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:50.393641 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a14d39a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:50.394598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:50.395036 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:50.395454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] PATH_INFO: `/v3/users/95ec86020ddb4e41be9561d1c03feffc` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:50.397577 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ec86020ddb4e41be9561d1c03feffc)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:50.400390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:50.482397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ec86020ddb4e41be9561d1c03feffc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:50.483771 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ec86020ddb4e41be9561d1c03feffc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:50.484617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ec86020ddb4e41be9561d1c03feffc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:50.517767 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ec86020ddb4e41be9561d1c03feffc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:50.527379 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ec86020ddb4e41be9561d1c03feffc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:50.540591 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1058/2110] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:50 2022] DELETE /identity/v3/users/95ec86020ddb4e41be9561d1c03feffc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:50.545082 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:50.545726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:50.545726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:50.563499 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:50.564712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:50.635671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1053/2111] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:50.647478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:50.650102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:50.712775 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04116fb6-87f3-4dd2-aa69-26765b6aa49a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:50.717992 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1516340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:50.718642 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:50.718916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:50.719186 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:50.728977 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:50.730611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:50.740751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1059/2112] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 13 12:55:51.100941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:51.106128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:51.120085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583e05e0-f002-4b63-b8d9-c2e61ee2a007 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:51.126982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a14a76a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:51.128126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:51.128615 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:51.129075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] PATH_INFO: `/v3/projects/3364902928b1495ca695449d490a4986` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:51.130779 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=3364902928b1495ca695449d490a4986)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:51.132905 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:51.182826 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3364902928b1495ca695449d490a4986', 'request_id': 'req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.191248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3364902928b1495ca695449d490a4986', 'request_id': 'req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.196866 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3364902928b1495ca695449d490a4986', 'request_id': 'req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.207938 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] The token cache is being invalidate because project 3364902928b1495ca695449d490a4986 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:51.208225 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.208868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.213432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1054/2113] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:51 2022] DELETE /identity/v3/projects/3364902928b1495ca695449d490a4986 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:51.214695 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:51.225310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d1af0-5417-410f-a5db-a81ffebea9ab service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:51.284257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a15252b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:51.285089 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:51.285360 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:51.285628 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] PATH_INFO: `/v3/users/56a3091e1eb847a68aba80f34b267e73` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:51.286825 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a3091e1eb847a68aba80f34b267e73)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:51.288717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:51.341674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a3091e1eb847a68aba80f34b267e73'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.343454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a3091e1eb847a68aba80f34b267e73'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.344176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a3091e1eb847a68aba80f34b267e73'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.356294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a3091e1eb847a68aba80f34b267e73'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.365102 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-dd9a7695-b152-4905-a9e6-e16b4d82b7cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a3091e1eb847a68aba80f34b267e73'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.377933 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1060/2114] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:55:51 2022] DELETE /identity/v3/users/56a3091e1eb847a68aba80f34b267e73 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:51.752346 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:51.760973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:51.786402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa7b7e-f555-4a1a-b12f-2d886d8e93ce admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:51.858908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=u9aEyIwQSGWJ-Qs_-C35RQ, audit_chain_id=['u9aEyIwQSGWJ-Qs_-C35RQ']) at 0x7fe8a15f6850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:51.859769 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:51.860052 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:51.860324 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] PATH_INFO: `/v3/projects/4e21c219e7b246ec96c4b3b9cebf3f81` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:51.861566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e21c219e7b246ec96c4b3b9cebf3f81)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:51.863522 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:51.913462 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e21c219e7b246ec96c4b3b9cebf3f81', 'request_id': 'req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.921928 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e21c219e7b246ec96c4b3b9cebf3f81', 'request_id': 'req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.927874 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e21c219e7b246ec96c4b3b9cebf3f81', 'request_id': 'req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.940263 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] The token cache is being invalidate because project 4e21c219e7b246ec96c4b3b9cebf3f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:55:51.940554 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.941272 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-f5eaac7e-9ddc-4aeb-ab0b-35448eee6b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:55:51.942892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1055/2115] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:55:51 2022] DELETE /identity/v3/projects/4e21c219e7b246ec96c4b3b9cebf3f81 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:51.947839 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:51.948129 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:51.948408 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:51.966670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:51.968063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:52.060510 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1061/2116] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:52.061655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.062155 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.062732 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.081912 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:52.083115 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:52.091085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1056/2117] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:52.097393 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.107257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af901e-010a-42c2-b24c-1f45824d7817 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.112619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a142e7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.113313 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.113596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.113870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.114603 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:55:52.114916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.116513 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.135091 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1062/2118] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:55:52.135937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.148844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4b3ce-6533-4b23-bfd8-07236ee5e8df None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.160683 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1a0e490>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.162128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.162450 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.162801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.163376 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.165828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.194758 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1057/2119] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:52 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:52.198911 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.211604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44261d00-3966-4718-a4e9-c5d3cb7e14f8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.294147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a0ff3370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.294865 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.295199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.295477 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.296404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.298449 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.325030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1063/2120] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:52 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:55:52.329743 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.344720 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603a041-6c89-4c6a-b032-0f5ac979a2bd admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.350906 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1556190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.351793 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.352072 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.352654 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.353609 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.355091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.369016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1058/2121] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:52.370966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.384921 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d807892-3879-43de-a473-d379b8778edf admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.401983 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b083f3-de6e-453b-b9bd-00f3e034fcb8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a103ad00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.402722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b083f3-de6e-453b-b9bd-00f3e034fcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.406454 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b083f3-de6e-453b-b9bd-00f3e034fcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.406744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b083f3-de6e-453b-b9bd-00f3e034fcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.407615 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b083f3-de6e-453b-b9bd-00f3e034fcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.409941 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b083f3-de6e-453b-b9bd-00f3e034fcb8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.427595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1064/2122] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:55:52.428527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.441891 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a1d62-f761-4ec4-8545-afb68526bb79 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.447904 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1549970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.448972 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.449439 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.450245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] PATH_INFO: `/v3/projects/84e3b22f6d964d1297ccd0dc8258586d/users/02f78d1e08c14d8f99eab07a1ac228e5/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.473125 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] RBAC: Authorizing `identity:create_grant(project_id=84e3b22f6d964d1297ccd0dc8258586d, user_id=02f78d1e08c14d8f99eab07a1ac228e5, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.476137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.492026 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1059/2123] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:52 2022] PUT /identity/v3/projects/84e3b22f6d964d1297ccd0dc8258586d/users/02f78d1e08c14d8f99eab07a1ac228e5/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:52.502838 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.503434 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.504031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.549039 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] MFA Rules not processed for user `02f78d1e08c14d8f99eab07a1ac228e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:52.550286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:52.641382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1065/2124] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:52.645801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.708896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a2409-0d3f-4fff-a099-e180ac0aecad admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.714716 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a19e3fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.715389 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.715666 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.715939 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.716635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.719520 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.751813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1060/2125] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:55:52 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:52.753065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.763506 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d129d24c-54bd-4390-a813-6673c15071bc None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.829759 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a17d3df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.830633 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.830919 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.831193 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.831892 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.834023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.862259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1066/2126] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:55:52 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:55:52.865736 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.878121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9341a6b3-e3c0-4412-86b4-44835fe5ad0b admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.883236 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1122190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.883894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.884603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.884603 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.885321 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.886915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.905815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1061/2127] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:52.909912 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.920489 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c961d-28c9-4b96-ac00-202a1c2e7fbd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:52.925268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a25a5730>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:52.926147 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:52.926472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:52.926742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] PATH_INFO: `/v3/projects/509c60598fa04a57acbd15edf035829c/users/c199b91ef52c4a3ea01327b3479a5833/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:52.947576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509c60598fa04a57acbd15edf035829c, user_id=c199b91ef52c4a3ea01327b3479a5833, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:52.950267 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:52.963963 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1067/2128] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:52 2022] PUT /identity/v3/projects/509c60598fa04a57acbd15edf035829c/users/c199b91ef52c4a3ea01327b3479a5833/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:55:52.968618 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:52.979089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e0b85-e4f1-4bfb-b3ec-d858403bc00d admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:53.036266 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5302ec89-ea44-4a2a-9cd8-a5dbf5e525c2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a14e0a30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:53.036930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ec89-ea44-4a2a-9cd8-a5dbf5e525c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:53.037245 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ec89-ea44-4a2a-9cd8-a5dbf5e525c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:53.037523 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5302ec89-ea44-4a2a-9cd8-a5dbf5e525c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:53.038278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ec89-ea44-4a2a-9cd8-a5dbf5e525c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:53.039889 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5302ec89-ea44-4a2a-9cd8-a5dbf5e525c2 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:53.049966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1062/2129] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:55:53.054262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:53.065622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fff0a-d0bc-48b6-8e95-4f83c2026300 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:53.070441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1523f10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:53.071376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:53.071658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:53.071932 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] PATH_INFO: `/v3/projects/509c60598fa04a57acbd15edf035829c/users/c199b91ef52c4a3ea01327b3479a5833/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:53.073945 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=509c60598fa04a57acbd15edf035829c, user_id=c199b91ef52c4a3ea01327b3479a5833, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:53.077185 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:53.087441 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1068/2130] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:55:53 2022] PUT /identity/v3/projects/509c60598fa04a57acbd15edf035829c/users/c199b91ef52c4a3ea01327b3479a5833/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:55:53.098057 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:53.098354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:53.098635 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:53.126246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] MFA Rules not processed for user `c199b91ef52c4a3ea01327b3479a5833`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:55:53.127500 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:53.199092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1063/2131] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:55:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:55:53.214859 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:53.216526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:55:53.278610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b21f0e5-bcee-4ca8-84eb-5ab0a6005ccd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:53.284027 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a158c3a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:53.284680 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:53.284956 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:53.285257 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:53.294202 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:53.296468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:53.307954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1069/2132] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:55:53.381998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:55:53.393947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e5d20-4d99-4d5f-8f88-822d94aa1e8f None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:55:53.398374 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222006e-9931-4feb-be2f-fb119c10f704 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a19d7df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:55:53.399027 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222006e-9931-4feb-be2f-fb119c10f704 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:55:53.399310 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222006e-9931-4feb-be2f-fb119c10f704 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:55:53.399586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222006e-9931-4feb-be2f-fb119c10f704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:55:53.456694 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222006e-9931-4feb-be2f-fb119c10f704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:55:53.458159 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6222006e-9931-4feb-be2f-fb119c10f704 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:55:53.466846 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1064/2133] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:55:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:06.393230 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:06.460507 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644f651-31b6-4220-a838-7ea8697e241c service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:06.465581 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1541bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:06.466555 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:06.466900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:06.467199 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] PATH_INFO: `/v3/users/02f78d1e08c14d8f99eab07a1ac228e5` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:06.468412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=02f78d1e08c14d8f99eab07a1ac228e5)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:06.471071 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:06.523095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02f78d1e08c14d8f99eab07a1ac228e5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:06.523753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02f78d1e08c14d8f99eab07a1ac228e5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:06.524419 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02f78d1e08c14d8f99eab07a1ac228e5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:06.538201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02f78d1e08c14d8f99eab07a1ac228e5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:06.556966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02f78d1e08c14d8f99eab07a1ac228e5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:06.574706 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1070/2134] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:06 2022] DELETE /identity/v3/users/02f78d1e08c14d8f99eab07a1ac228e5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:06.580762 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:06.582172 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:06.582937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:06.604345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:06.607080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:06.708783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1065/2135] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:56:06.725276 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:06.726983 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:06.812522 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7f007-cd4c-44f4-aedd-19e0c4f43c0b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:06.816796 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=6zXPAbt4TMiz5mS8GppY2Q, audit_chain_id=['6zXPAbt4TMiz5mS8GppY2Q']) at 0x7fe8a153b4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:06.817540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:06.818014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:06.818286 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:06.830030 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:06.831553 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:06.843928 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1071/2136] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:07.127212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:07.128728 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:07.140364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9626f97f-e7aa-4d75-a992-099b4ddc6542 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:07.145036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a1098250>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:07.145896 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:07.146177 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:07.146441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] PATH_INFO: `/v3/projects/84e3b22f6d964d1297ccd0dc8258586d` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:07.147619 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84e3b22f6d964d1297ccd0dc8258586d)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:07.149828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:07.200058 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84e3b22f6d964d1297ccd0dc8258586d', 'request_id': 'req-86663a80-69c4-4b4d-a5d7-34189a263334'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.208327 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84e3b22f6d964d1297ccd0dc8258586d', 'request_id': 'req-86663a80-69c4-4b4d-a5d7-34189a263334'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.214287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84e3b22f6d964d1297ccd0dc8258586d', 'request_id': 'req-86663a80-69c4-4b4d-a5d7-34189a263334'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.225903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] The token cache is being invalidate because project 84e3b22f6d964d1297ccd0dc8258586d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:07.226188 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.226832 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.228608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1066/2137] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:07 2022] DELETE /identity/v3/projects/84e3b22f6d964d1297ccd0dc8258586d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:07.232542 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:07.243807 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b9b98-c208-41bb-a3cc-4386f4f96ccc service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:07.315009 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a157c190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:07.315207 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:07.315658 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:07.315937 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] PATH_INFO: `/v3/users/c199b91ef52c4a3ea01327b3479a5833` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:07.317167 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c199b91ef52c4a3ea01327b3479a5833)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:07.319072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:07.378736 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c199b91ef52c4a3ea01327b3479a5833'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.379447 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c199b91ef52c4a3ea01327b3479a5833'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.380176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c199b91ef52c4a3ea01327b3479a5833'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.393520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c199b91ef52c4a3ea01327b3479a5833'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.402609 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6dc38274-21fa-4d12-991b-781274599f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c199b91ef52c4a3ea01327b3479a5833'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.417263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1072/2138] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:07 2022] DELETE /identity/v3/users/c199b91ef52c4a3ea01327b3479a5833 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:07.690132 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:07.691668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:07.704590 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86663a80-69c4-4b4d-a5d7-34189a263334 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:07.766118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=7kX20XGXSoah7Wc2nWf9Hw, audit_chain_id=['7kX20XGXSoah7Wc2nWf9Hw']) at 0x7fe8a109a8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:07.766951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:07.767232 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:07.767506 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] PATH_INFO: `/v3/projects/509c60598fa04a57acbd15edf035829c` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:07.768833 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509c60598fa04a57acbd15edf035829c)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:07.770745 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:07.822132 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509c60598fa04a57acbd15edf035829c', 'request_id': 'req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.831877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509c60598fa04a57acbd15edf035829c', 'request_id': 'req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.838030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509c60598fa04a57acbd15edf035829c', 'request_id': 'req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.857902 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] The token cache is being invalidate because project 509c60598fa04a57acbd15edf035829c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:07.858249 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.858908 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-bb2776d1-63e7-45be-9f02-6fb2a14a7e25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:07.861214 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1067/2139] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:07 2022] DELETE /identity/v3/projects/509c60598fa04a57acbd15edf035829c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:07.866198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:07.866605 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:07.866961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:07.885523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:07.887150 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:07.953103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1073/2140] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:07.962246 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:07.962533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:07.962815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:07.982216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:07.983416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:07.991639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1068/2141] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:07.995935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.006212 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83507aa1-679f-4fac-83ab-496cec44d1f7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.010819 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1563310>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.011473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.011754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.012029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.012751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:56:08.013084 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.014672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.030391 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1074/2142] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:56:08.031549 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.041030 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dfdee-9f8e-458c-8a36-91b01c4c7c9c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.045742 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a18485e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.046470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.046757 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.047028 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.047706 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.049845 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.076215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1069/2143] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:08 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:08.081124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.091871 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e137e-a1e1-4310-a8fa-3b21da18cff8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.149262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a182c4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.149929 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.150208 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.150480 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.151159 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.153359 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.174720 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1075/2144] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:08 2022] POST /identity/v3/users => generated 279 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:56:08.178873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.189285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cd75d-413c-45d9-bb73-c10b0b76cf76 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.194407 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a19b5160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.195080 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.195360 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.195628 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.196359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.197982 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.209210 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1070/2145] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:56:08.213188 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.224078 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9b720-92eb-425e-9d7b-4ad72d45ee60 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.228734 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f764b-9ddd-4d53-9e1d-cc5acd8fa0e1 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a0f9fa90>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.229422 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f764b-9ddd-4d53-9e1d-cc5acd8fa0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.229703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f764b-9ddd-4d53-9e1d-cc5acd8fa0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.229973 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f764b-9ddd-4d53-9e1d-cc5acd8fa0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.230733 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f764b-9ddd-4d53-9e1d-cc5acd8fa0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.232333 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f764b-9ddd-4d53-9e1d-cc5acd8fa0e1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.246792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1076/2146] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:08.248330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.260045 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d916a-45fd-4ac7-86ed-624343295aa7 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.264909 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a15310d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.265838 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.266120 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.266539 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] PATH_INFO: `/v3/projects/ca93694fdd0b4705ab07a09603b7de07/users/d0d4688263fd4336b5bb734c339c7076/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.285219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca93694fdd0b4705ab07a09603b7de07, user_id=d0d4688263fd4336b5bb734c339c7076, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.287821 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.303294 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1071/2147] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:08 2022] PUT /identity/v3/projects/ca93694fdd0b4705ab07a09603b7de07/users/d0d4688263fd4336b5bb734c339c7076/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:08.313472 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.314038 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.314337 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.341443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] MFA Rules not processed for user `d0d4688263fd4336b5bb734c339c7076`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:08.342703 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:08.423803 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1077/2148] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:08.426000 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.490924 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db478b-0bee-4cbc-9ab4-d36f8b0ecec7 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.495638 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1582640>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.496323 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.496605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.496879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.497604 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.500121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.526067 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1072/2149] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:08 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:08.530671 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.545055 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda33e9f-e2c7-4b41-977e-72d779391956 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.602436 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1579370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.603221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.603498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.603766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.604458 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.606392 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.624853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1078/2150] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:08 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:08.628848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.639110 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f87176-8701-4122-a673-f085a55aed4a admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.644348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1557400>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.645007 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.645330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.645607 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.646330 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.647915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.659083 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1073/2151] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:08.663101 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.672639 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae549a-240d-400f-bc9c-82684d8e5aca admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.677189 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1579c40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.678040 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.678317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.678584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] PATH_INFO: `/v3/projects/6978787411a3418dbd490868327fe30b/users/cb8ff392c97944289155248ab3a2efa7/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.692652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6978787411a3418dbd490868327fe30b, user_id=cb8ff392c97944289155248ab3a2efa7, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.695294 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.708236 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1079/2152] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:08 2022] PUT /identity/v3/projects/6978787411a3418dbd490868327fe30b/users/cb8ff392c97944289155248ab3a2efa7/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:56:08.712128 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.722421 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d63cd8-1b26-4e58-a82f-bed258b2adfb admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.778354 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbb2fc-9e16-4737-9c7d-ecccc389801d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a15ff6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.779017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb2fc-9e16-4737-9c7d-ecccc389801d admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.779299 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb2fc-9e16-4737-9c7d-ecccc389801d admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.779572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbb2fc-9e16-4737-9c7d-ecccc389801d admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.780301 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbb2fc-9e16-4737-9c7d-ecccc389801d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.781919 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbb2fc-9e16-4737-9c7d-ecccc389801d admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.791419 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1074/2153] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:08.796085 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.806473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a689bc8-010c-451c-a7a9-19e4dde45bc7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:08.811072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a184b7c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:08.811942 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.812221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.812496 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] PATH_INFO: `/v3/projects/6978787411a3418dbd490868327fe30b/users/cb8ff392c97944289155248ab3a2efa7/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.815399 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6978787411a3418dbd490868327fe30b, user_id=cb8ff392c97944289155248ab3a2efa7, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:08.818073 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:08.828033 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1080/2154] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:08 2022] PUT /identity/v3/projects/6978787411a3418dbd490868327fe30b/users/cb8ff392c97944289155248ab3a2efa7/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:08.839563 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:08.839856 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:08.840137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:08.867239 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] MFA Rules not processed for user `cb8ff392c97944289155248ab3a2efa7`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:08.868444 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:08.937825 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1075/2155] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:08 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:56:08.949301 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:08.951014 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:09.010743 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073b9ba0-a015-44cb-bdfb-1cc43806701f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:09.014096 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a1338dc0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:09.014729 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:09.015001 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:09.015273 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:09.025232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:09.026644 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:09.037300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1081/2156] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:08 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:09.109947 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:09.119801 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ad0ac-41ad-45b6-9eed-29800941a2ad None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:09.123545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfb045-0b97-4c3d-a56b-576a86b8923a service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a152d430>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:09.124176 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb045-0b97-4c3d-a56b-576a86b8923a service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:09.124456 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb045-0b97-4c3d-a56b-576a86b8923a service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:09.124726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfb045-0b97-4c3d-a56b-576a86b8923a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:09.179469 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb045-0b97-4c3d-a56b-576a86b8923a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:09.180895 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfb045-0b97-4c3d-a56b-576a86b8923a service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:09.190231 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1076/2157] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:09 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:19.777215 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:19.778978 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:19.903025 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadcade3-d68e-43a2-b13b-a3927ef4d8cf service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:19.907622 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a1541bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:19.908478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:19.908756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:19.909064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] PATH_INFO: `/v3/users/4010456427774af0a07185735b5ceb97` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:19.910253 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4010456427774af0a07185735b5ceb97)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:19.912782 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:19.956600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4010456427774af0a07185735b5ceb97'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:19.957269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4010456427774af0a07185735b5ceb97'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:19.957895 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4010456427774af0a07185735b5ceb97'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:19.973124 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4010456427774af0a07185735b5ceb97'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:19.978308 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4010456427774af0a07185735b5ceb97'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:19.991205 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1082/2158] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:19 2022] DELETE /identity/v3/users/4010456427774af0a07185735b5ceb97 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:19.995676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:19.996163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:19.996274 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.023253 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:20.024377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:20.084668 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1077/2159] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:20.094412 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:20.095976 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:20.198293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da316c4d-f814-4b5d-a892-d28c8e01493c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:20.202235 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83749eed-c397-481a-addd-7c62bb965194 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a0ff3fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:20.202885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83749eed-c397-481a-addd-7c62bb965194 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:20.203164 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83749eed-c397-481a-addd-7c62bb965194 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:20.203993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83749eed-c397-481a-addd-7c62bb965194 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.213867 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83749eed-c397-481a-addd-7c62bb965194 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:20.215296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83749eed-c397-481a-addd-7c62bb965194 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:20.226187 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1083/2160] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:20.508811 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:20.510398 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:20.525161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb3d92f-500b-445f-85bf-7b66d7a0dc28 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:20.530482 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=nS89OA0VRnSyZemPFV4mHw, audit_chain_id=['nS89OA0VRnSyZemPFV4mHw']) at 0x7fe8a1582d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:20.531348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:20.531629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:20.531903 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] PATH_INFO: `/v3/projects/b43aaa1fe2b74a9a9bb27ff1cf18c4a1` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.533193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b43aaa1fe2b74a9a9bb27ff1cf18c4a1)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:20.535106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:20.595292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b43aaa1fe2b74a9a9bb27ff1cf18c4a1', 'request_id': 'req-a801217f-58df-4bd0-8128-dcd1aea3ce3b'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:20.605340 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b43aaa1fe2b74a9a9bb27ff1cf18c4a1', 'request_id': 'req-a801217f-58df-4bd0-8128-dcd1aea3ce3b'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:20.611543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b43aaa1fe2b74a9a9bb27ff1cf18c4a1', 'request_id': 'req-a801217f-58df-4bd0-8128-dcd1aea3ce3b'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:20.624700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] The token cache is being invalidate because project b43aaa1fe2b74a9a9bb27ff1cf18c4a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:20.625215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:20.625930 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-a801217f-58df-4bd0-8128-dcd1aea3ce3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:20.627818 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1078/2161] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:20 2022] DELETE /identity/v3/projects/b43aaa1fe2b74a9a9bb27ff1cf18c4a1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:20.633241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:20.633523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:20.633870 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.680335 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:20.681673 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:20.758548 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1084/2162] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:20.765782 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:20.766086 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:20.766727 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.797244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:20.797244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:20.804671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1079/2163] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:20.809008 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:20.820953 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6191b64-1b02-42af-a10a-9ffc8c45f20c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:20.833500 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qNFZbNZ8TeysK80fImQe6g, audit_chain_id=['qNFZbNZ8TeysK80fImQe6g']) at 0x7fe8a180ca30>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:20.834190 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:20.834459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:20.834908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.835823 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:56:20.836293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:20.838169 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:20.864566 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1085/2164] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:56:20.870887 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:20.886270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428fe8f0-d16a-40a6-8e25-2fe831908ea6 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:20.894316 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qNFZbNZ8TeysK80fImQe6g, audit_chain_id=['qNFZbNZ8TeysK80fImQe6g']) at 0x7fe8a183fd60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:20.895281 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:20.896035 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:20.896381 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:20.898328 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:20.903269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:20.945020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1080/2165] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:20 2022] POST /identity/v3/projects => generated 365 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:20.947569 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:20.957930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950a725-1abf-4058-bbe3-797e9906f468 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:21.025247 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qNFZbNZ8TeysK80fImQe6g, audit_chain_id=['qNFZbNZ8TeysK80fImQe6g']) at 0x7fe8a155fe50>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:21.025978 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:21.026259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:21.026529 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:21.027225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:21.029488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:21.048756 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1086/2166] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:20 2022] POST /identity/v3/users => generated 283 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:56:21.052698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:21.063113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498037-b1a6-4170-914c-ebfaad2e0c60 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:21.068748 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qNFZbNZ8TeysK80fImQe6g, audit_chain_id=['qNFZbNZ8TeysK80fImQe6g']) at 0x7fe8a15172e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:21.070151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:21.070436 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:21.070715 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:21.071828 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:21.073493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:21.084764 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1081/2167] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:21.089045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:21.099289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb27dd-866e-477a-a760-b3c17fd2b816 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:21.104409 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7042529d-5eea-4248-b140-05a96bda3c8f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qNFZbNZ8TeysK80fImQe6g, audit_chain_id=['qNFZbNZ8TeysK80fImQe6g']) at 0x7fe8a1579370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:21.105083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042529d-5eea-4248-b140-05a96bda3c8f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:21.105370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042529d-5eea-4248-b140-05a96bda3c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:21.105626 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7042529d-5eea-4248-b140-05a96bda3c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:21.106342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042529d-5eea-4248-b140-05a96bda3c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:21.107916 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7042529d-5eea-4248-b140-05a96bda3c8f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:21.117993 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1087/2168] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:21.122147 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:21.131955 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae5fa5-6d0d-45bf-bb5a-8a0b052f833e admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:21.136591 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=qNFZbNZ8TeysK80fImQe6g, audit_chain_id=['qNFZbNZ8TeysK80fImQe6g']) at 0x7fe8a15491f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:21.137481 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:21.137766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:21.138037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] PATH_INFO: `/v3/projects/7d40149bcce54134817f0e22fdc3eb1c/users/929988926bfa437eb22d32ca2c857e66/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:21.153545 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d40149bcce54134817f0e22fdc3eb1c, user_id=929988926bfa437eb22d32ca2c857e66, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:21.156191 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:21.169211 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1082/2169] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:21 2022] PUT /identity/v3/projects/7d40149bcce54134817f0e22fdc3eb1c/users/929988926bfa437eb22d32ca2c857e66/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:56:21.179311 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:21.179602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:21.179882 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:21.208046 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] MFA Rules not processed for user `929988926bfa437eb22d32ca2c857e66`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:21.209596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:21.277219 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1088/2170] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:21.291133 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:21.292913 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:21.361743 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b82f0-8359-40fb-99b8-f5062f4e9cb2 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:21.366309 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb965be3-c87e-42b2-968f-d5ba5630b460 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=QelMcwqdSUO6hCXwUVITsg, audit_chain_id=['QelMcwqdSUO6hCXwUVITsg']) at 0x7fe8a15618b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:21.366974 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb965be3-c87e-42b2-968f-d5ba5630b460 service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:21.367247 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb965be3-c87e-42b2-968f-d5ba5630b460 service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:21.367518 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb965be3-c87e-42b2-968f-d5ba5630b460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:21.376719 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb965be3-c87e-42b2-968f-d5ba5630b460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:21.378207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb965be3-c87e-42b2-968f-d5ba5630b460 service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:21.388766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1083/2171] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:24.183137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:24.184520 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:24.249397 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf00a1d7-4025-41ae-aa1c-9195e726f9d9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:24.253958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a14e2e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:24.254821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:24.255813 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:24.256093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] PATH_INFO: `/v3/users/1ce7eb18817649f2861d968683488cf7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:24.257318 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce7eb18817649f2861d968683488cf7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:24.259223 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:24.307218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce7eb18817649f2861d968683488cf7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.308146 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce7eb18817649f2861d968683488cf7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.309031 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce7eb18817649f2861d968683488cf7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.321630 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce7eb18817649f2861d968683488cf7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.329047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce7eb18817649f2861d968683488cf7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.341526 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1089/2172] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:24 2022] DELETE /identity/v3/users/1ce7eb18817649f2861d968683488cf7 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:24.346148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:24.346774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:24.346774 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:24.366054 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:24.367243 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:24.430766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1084/2173] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:24.440296 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:24.441699 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:24.509578 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb5ac67-37d7-4815-a3f3-94bed51f2433 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:24.513320 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a13302b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:24.513969 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:24.514327 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:24.514598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:24.524141 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:24.525638 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:24.535398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1090/2174] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:24.829438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:24.830980 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:24.843640 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f7b78-aa27-4ff6-844d-0cb44fa4c8ef None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:24.848645 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=zUVAWAD2Qnaml8gSTNWmBQ, audit_chain_id=['zUVAWAD2Qnaml8gSTNWmBQ']) at 0x7fe8a1122190>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:24.849574 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:24.849915 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:24.850297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] PATH_INFO: `/v3/projects/5d20cbb46b014b0aa2b6266d64820a66` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:24.851546 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d20cbb46b014b0aa2b6266d64820a66)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:24.853495 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:24.901977 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d20cbb46b014b0aa2b6266d64820a66', 'request_id': 'req-e04fcc69-64c3-47de-a37b-fda25af02dfd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.909822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d20cbb46b014b0aa2b6266d64820a66', 'request_id': 'req-e04fcc69-64c3-47de-a37b-fda25af02dfd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.916017 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d20cbb46b014b0aa2b6266d64820a66', 'request_id': 'req-e04fcc69-64c3-47de-a37b-fda25af02dfd'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.927632 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] The token cache is being invalidate because project 5d20cbb46b014b0aa2b6266d64820a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:24.928099 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.928749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-e04fcc69-64c3-47de-a37b-fda25af02dfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:24.930379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1085/2175] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:24 2022] DELETE /identity/v3/projects/5d20cbb46b014b0aa2b6266d64820a66 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:26.113913 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:26.117152 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:26.129872 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb1d50-3759-403f-b052-fee1a09e4c55 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:26.187884 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1819e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:26.188757 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:26.189069 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:26.189351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] PATH_INFO: `/v3/users/d0d4688263fd4336b5bb734c339c7076` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:26.190546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0d4688263fd4336b5bb734c339c7076)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:26.192722 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:26.241464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0d4688263fd4336b5bb734c339c7076'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.242142 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0d4688263fd4336b5bb734c339c7076'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.242738 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0d4688263fd4336b5bb734c339c7076'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.254225 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0d4688263fd4336b5bb734c339c7076'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.261127 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0d4688263fd4336b5bb734c339c7076'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.274300 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1091/2176] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:26 2022] DELETE /identity/v3/users/d0d4688263fd4336b5bb734c339c7076 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:26.279152 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:26.279560 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:26.279707 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:26.298297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:26.299487 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:26.358199 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1086/2177] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:26.368376 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:26.369954 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:26.429163 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0eda5a-0ddc-4bde-82ae-76484fcc2945 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:26.432901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a17d3df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:26.433575 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:26.434119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:26.434395 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:26.443893 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:26.445336 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:26.455234 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1092/2178] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:26.749785 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:26.751885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:26.781076 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f641da5-bc44-4af5-a2fc-5ff51b27f4b2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:26.791322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1f5fee0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:26.793726 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:26.794075 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:26.794362 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] PATH_INFO: `/v3/projects/ca93694fdd0b4705ab07a09603b7de07` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:26.795917 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca93694fdd0b4705ab07a09603b7de07)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:26.798510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:26.859973 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca93694fdd0b4705ab07a09603b7de07', 'request_id': 'req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.869352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca93694fdd0b4705ab07a09603b7de07', 'request_id': 'req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.875510 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca93694fdd0b4705ab07a09603b7de07', 'request_id': 'req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.887379 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] The token cache is being invalidate because project ca93694fdd0b4705ab07a09603b7de07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:26.887671 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.888322 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:26.889931 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1087/2179] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:26 2022] DELETE /identity/v3/projects/ca93694fdd0b4705ab07a09603b7de07 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:26.893927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:26.904352 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7e78e-9422-4062-8dec-3d87a7180452 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:26.960897 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a1532d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:26.961797 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:26.962076 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:26.962346 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] PATH_INFO: `/v3/users/cb8ff392c97944289155248ab3a2efa7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:26.963525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8ff392c97944289155248ab3a2efa7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:26.965523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.009996 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8ff392c97944289155248ab3a2efa7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.010781 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8ff392c97944289155248ab3a2efa7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.011368 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8ff392c97944289155248ab3a2efa7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.023795 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8ff392c97944289155248ab3a2efa7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.031400 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8832f455-118e-4419-9231-7f1ae7f2a3ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8ff392c97944289155248ab3a2efa7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.044753 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1093/2180] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:26 2022] DELETE /identity/v3/users/cb8ff392c97944289155248ab3a2efa7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:27.337016 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.338556 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:27.351840 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bfdfa-ebf8-4fd5-bb59-faada87823ce admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.416610 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=yoQ5JCdESParBiVP4SlvRQ, audit_chain_id=['yoQ5JCdESParBiVP4SlvRQ']) at 0x7fe8a19a84f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.417499 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.417951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.418222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] PATH_INFO: `/v3/projects/6978787411a3418dbd490868327fe30b` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.419416 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6978787411a3418dbd490868327fe30b)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.421401 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.467432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6978787411a3418dbd490868327fe30b', 'request_id': 'req-79c6bed5-9287-4144-a41e-2cc2882efe0f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.475248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6978787411a3418dbd490868327fe30b', 'request_id': 'req-79c6bed5-9287-4144-a41e-2cc2882efe0f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.480713 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6978787411a3418dbd490868327fe30b', 'request_id': 'req-79c6bed5-9287-4144-a41e-2cc2882efe0f'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.491870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] The token cache is being invalidate because project 6978787411a3418dbd490868327fe30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:27.492148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.492783 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-79c6bed5-9287-4144-a41e-2cc2882efe0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:27.494338 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1088/2181] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:27 2022] DELETE /identity/v3/projects/6978787411a3418dbd490868327fe30b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:27.499277 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.499766 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.499898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.518853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:27.520252 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:27.580288 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1094/2182] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:27.588568 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.588855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.589171 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.607656 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:27.608835 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:27.617680 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1089/2183] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:27.621918 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.631459 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d793ee2-9320-4aa9-822d-a9cfa7575046 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.636093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a17ee580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.636737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.637047 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.637321 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.638064 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:56:27.638370 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.639946 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.651689 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1095/2184] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:56:27.656254 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.665966 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb5bf0-ba6e-432e-a5d6-2de3263b0e4a None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.670470 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a19d7df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.671104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.671385 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.671655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.672333 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.674240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.699493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1090/2185] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:27 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:27.703067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.713833 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da2ede-fda4-413a-a001-ed00a5782350 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.771237 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a0ffb760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.772075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.772351 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.772618 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.773342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.775263 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.795693 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1096/2186] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:27 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:27.799704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.810289 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715db556-cfab-484c-9c4e-9ff8751ae401 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.815189 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a14d1ac0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.815842 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.816121 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.816394 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.817145 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.818942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.829084 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1091/2187] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:27.833499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.843468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834f2a9f-ef10-43bc-9f17-416aa418942f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.848045 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f99ad-7b01-448d-9569-8fc1a371666e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a0f722b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.849595 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f99ad-7b01-448d-9569-8fc1a371666e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.850067 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f99ad-7b01-448d-9569-8fc1a371666e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.850349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f99ad-7b01-448d-9569-8fc1a371666e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.851083 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f99ad-7b01-448d-9569-8fc1a371666e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.852684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f99ad-7b01-448d-9569-8fc1a371666e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.864095 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1097/2188] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:27.867141 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:27.877024 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8534b03-0882-4cd7-9c3b-bf9a6d15bacc admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:27.881998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a152d340>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:27.882873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.883158 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.883432 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] PATH_INFO: `/v3/projects/37b958aa531b48038da13387c25bd065/users/508a68d0bf444576844252aeb94c2fcf/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.900876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37b958aa531b48038da13387c25bd065, user_id=508a68d0bf444576844252aeb94c2fcf, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:27.902070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:27.916270 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1092/2189] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:27 2022] PUT /identity/v3/projects/37b958aa531b48038da13387c25bd065/users/508a68d0bf444576844252aeb94c2fcf/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:56:27.926598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:27.926943 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:27.927259 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:27.953909 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] MFA Rules not processed for user `508a68d0bf444576844252aeb94c2fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:27.955126 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:28.019904 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1098/2190] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:28.024511 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.086508 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434c054-0d6d-4bed-9836-914b4d5ff065 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.092106 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a1821df0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.092815 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.093192 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.093446 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.094293 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.096371 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.125240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1093/2191] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:28 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:28.129062 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.147582 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c638e0e-3db4-4791-8f8f-a58fafb1d1f9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.205820 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a1579550>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.206486 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.206762 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.207029 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.207717 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.209678 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.232709 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1099/2192] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:28 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:28.234169 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.245941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c7ce9-8e2c-46c7-a7db-935d6f1e4ff3 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.250871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a1581d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.251528 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.251813 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.252091 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.252819 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.254533 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.265460 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1094/2193] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:56:28.269554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.280022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca46a3a-d5f2-472e-babe-4584db4d2625 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.284878 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a1ffdf40>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.285804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.286672 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.287128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] PATH_INFO: `/v3/projects/bdab94d983404c62b96c66e59be8c1c3/users/dc1b02eb267d4b1581ed4b66ef6438e2/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.302416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdab94d983404c62b96c66e59be8c1c3, user_id=dc1b02eb267d4b1581ed4b66ef6438e2, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.305675 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.319160 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1100/2194] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:28 2022] PUT /identity/v3/projects/bdab94d983404c62b96c66e59be8c1c3/users/dc1b02eb267d4b1581ed4b66ef6438e2/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:28.323217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.333178 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81abe760-2104-4fbf-bbe3-3db32b5464be admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.390250 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11403a7-9267-437e-89cb-f72f18e7d92c admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a19bff70>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.390918 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11403a7-9267-437e-89cb-f72f18e7d92c admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.391185 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11403a7-9267-437e-89cb-f72f18e7d92c admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.391464 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11403a7-9267-437e-89cb-f72f18e7d92c admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.392209 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11403a7-9267-437e-89cb-f72f18e7d92c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.393892 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11403a7-9267-437e-89cb-f72f18e7d92c admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.404342 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1095/2195] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:56:28.408473 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.419545 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a181d8-da2c-43c9-9963-8f70240cf34d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.424149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a1429af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.425042 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.425322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.425596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] PATH_INFO: `/v3/projects/bdab94d983404c62b96c66e59be8c1c3/users/dc1b02eb267d4b1581ed4b66ef6438e2/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.428310 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdab94d983404c62b96c66e59be8c1c3, user_id=dc1b02eb267d4b1581ed4b66ef6438e2, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.431007 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.441740 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1101/2196] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:28 2022] PUT /identity/v3/projects/bdab94d983404c62b96c66e59be8c1c3/users/dc1b02eb267d4b1581ed4b66ef6438e2/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:28.453287 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.453585 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.453868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.483014 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] MFA Rules not processed for user `dc1b02eb267d4b1581ed4b66ef6438e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:28.484224 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:28.557104 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1096/2197] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:28.568137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:28.569949 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:28.629940 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d882fb-3792-4c3b-a63a-6ecb069cd718 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:28.635137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05fac4-3ae8-44ab-a753-479e1c2db927 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1568d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:28.636066 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05fac4-3ae8-44ab-a753-479e1c2db927 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:28.636478 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05fac4-3ae8-44ab-a753-479e1c2db927 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:28.636883 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05fac4-3ae8-44ab-a753-479e1c2db927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:28.651137 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05fac4-3ae8-44ab-a753-479e1c2db927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:28.652592 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05fac4-3ae8-44ab-a753-479e1c2db927 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:28.664602 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1102/2198] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:29.226616 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:29.300170 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad480db-f12a-40ac-b8ae-8cc980ecf309 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:29.305944 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a120bca0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:29.306805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:29.307216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:29.307570 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] PATH_INFO: `/v3/users/508a68d0bf444576844252aeb94c2fcf` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:29.308768 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=508a68d0bf444576844252aeb94c2fcf)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:29.310776 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:29.357689 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '508a68d0bf444576844252aeb94c2fcf'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.358341 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '508a68d0bf444576844252aeb94c2fcf'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.358943 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '508a68d0bf444576844252aeb94c2fcf'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.371229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '508a68d0bf444576844252aeb94c2fcf'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.378998 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '508a68d0bf444576844252aeb94c2fcf'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.392655 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1097/2199] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:29 2022] DELETE /identity/v3/users/508a68d0bf444576844252aeb94c2fcf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:29.397598 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:29.398306 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:29.398587 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:29.417714 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:29.418922 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:29.476315 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1103/2200] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:29.485697 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:29.487113 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:29.544156 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad7a28b-1000-4ba5-b34a-2455572a1cd6 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:29.547790 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a1c564f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:29.548426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:29.548712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:29.549003 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:29.558494 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:29.559922 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:29.570676 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1098/2201] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:29.884546 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:29.886037 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:29.898322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2be50d-718e-40cf-baa4-2cf62d3a3820 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:29.903625 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a18c5fd0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:29.904481 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:29.904768 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:29.905057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] PATH_INFO: `/v3/projects/37b958aa531b48038da13387c25bd065` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:29.906268 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37b958aa531b48038da13387c25bd065)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:29.912669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:29.959907 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37b958aa531b48038da13387c25bd065', 'request_id': 'req-521356b2-a2fb-4c80-8720-4e49628cd2e3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.966854 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37b958aa531b48038da13387c25bd065', 'request_id': 'req-521356b2-a2fb-4c80-8720-4e49628cd2e3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.972530 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37b958aa531b48038da13387c25bd065', 'request_id': 'req-521356b2-a2fb-4c80-8720-4e49628cd2e3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.984686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] The token cache is being invalidate because project 37b958aa531b48038da13387c25bd065 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:29.984971 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.985630 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:29.987192 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1104/2202] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:29 2022] DELETE /identity/v3/projects/37b958aa531b48038da13387c25bd065 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:29.991827 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:30.001438 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4826e180-2e52-48c1-8a5e-d15c1477a7fc service neutron] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:30.057562 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a15310d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:30.058343 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.058624 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.058897 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] PATH_INFO: `/v3/users/dc1b02eb267d4b1581ed4b66ef6438e2` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.060070 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc1b02eb267d4b1581ed4b66ef6438e2)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:30.062037 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:30.111278 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc1b02eb267d4b1581ed4b66ef6438e2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.112331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc1b02eb267d4b1581ed4b66ef6438e2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.113297 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc1b02eb267d4b1581ed4b66ef6438e2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.132331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc1b02eb267d4b1581ed4b66ef6438e2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.139797 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-40a819a9-83f9-46fc-89f9-949a83cd7871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc1b02eb267d4b1581ed4b66ef6438e2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.158092 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1099/2203] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:29 2022] DELETE /identity/v3/users/dc1b02eb267d4b1581ed4b66ef6438e2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:30.480975 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:30.482525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:30.504317 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521356b2-a2fb-4c80-8720-4e49628cd2e3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:30.564832 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=KoatgeZRQc6jQPe37FeX1A, audit_chain_id=['KoatgeZRQc6jQPe37FeX1A']) at 0x7fe8a15252b0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:30.565636 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.565910 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.566183 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] PATH_INFO: `/v3/projects/bdab94d983404c62b96c66e59be8c1c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.567885 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdab94d983404c62b96c66e59be8c1c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:30.569898 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:30.617617 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdab94d983404c62b96c66e59be8c1c3', 'request_id': 'req-360524f8-c6ea-42d0-bdae-b9106ca935fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.624924 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdab94d983404c62b96c66e59be8c1c3', 'request_id': 'req-360524f8-c6ea-42d0-bdae-b9106ca935fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.631177 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdab94d983404c62b96c66e59be8c1c3', 'request_id': 'req-360524f8-c6ea-42d0-bdae-b9106ca935fa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.642464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] The token cache is being invalidate because project bdab94d983404c62b96c66e59be8c1c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:30.642752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.643404 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-360524f8-c6ea-42d0-bdae-b9106ca935fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:30.645157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1105/2204] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:30 2022] DELETE /identity/v3/projects/bdab94d983404c62b96c66e59be8c1c3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:30.650529 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.651011 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.651103 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.669659 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:30.670847 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:30.728958 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1100/2205] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:30.736584 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.736863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.737176 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.755403 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:30.756596 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:30.764241 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1106/2206] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:30.768244 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:30.779493 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8d59e-f502-4894-a9d4-a211b246483c None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:30.784465 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a123a4c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:30.785150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.785426 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.785696 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] PATH_INFO: `/v3/domains` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.787002 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86344) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:56:30.787305 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:30.788872 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:30.800051 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1101/2207] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:56:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:56:30.804338 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:30.813479 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b7e77-3cf7-4991-bf69-b61a0775a897 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:30.818611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a1103bb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:30.819232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.819523 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.819821 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.820491 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:30.822407 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:30.851901 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1107/2208] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:30 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:30.853445 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:30.863595 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9a871-50fc-4faf-8906-9e160b6c4dca admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:30.923766 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a18485e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:30.924433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.924717 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.925019 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.925718 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:30.927698 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:30.950791 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1102/2209] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:30 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:30.952000 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:30.965057 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10365e-4767-4996-bbcf-2c0211d46417 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:30.975016 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a153b4f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:30.976021 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:30.976464 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:30.976879 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:30.978554 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:30.980217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:30.991340 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1108/2210] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:30.995377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.005738 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2209ea-1390-432c-a5dc-947b510f6898 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.010331 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258aa77-fdf8-4fc1-bc79-e4676c2f1be3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a1c5ceb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.010984 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258aa77-fdf8-4fc1-bc79-e4676c2f1be3 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.011265 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258aa77-fdf8-4fc1-bc79-e4676c2f1be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.011542 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258aa77-fdf8-4fc1-bc79-e4676c2f1be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.012262 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258aa77-fdf8-4fc1-bc79-e4676c2f1be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.013894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258aa77-fdf8-4fc1-bc79-e4676c2f1be3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.025231 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1103/2211] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:31.029649 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.040468 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e57f7-2ce8-443a-93fb-b9f6f8f0411a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.045065 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a155e160>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.045927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.046201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.046467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] PATH_INFO: `/v3/projects/b8b3ae633e684497b8c76093579a662e/users/62debe8fba3542948d95387f9b178b70/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.060589 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b3ae633e684497b8c76093579a662e, user_id=62debe8fba3542948d95387f9b178b70, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.063271 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.077238 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1109/2212] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:31 2022] PUT /identity/v3/projects/b8b3ae633e684497b8c76093579a662e/users/62debe8fba3542948d95387f9b178b70/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:31.089144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.089437 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.089744 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.115962 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] MFA Rules not processed for user `62debe8fba3542948d95387f9b178b70`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:31.117269 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:31.180161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1104/2213] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:31.184619 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.244451 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70401f-beb5-408b-8465-4de5aff4a054 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.249098 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a14baeb0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.249744 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.250022 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.250293 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.250981 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.252863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.278610 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1110/2214] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:31 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:31.282870 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.297086 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f311d-1c3d-4540-a3ae-02e083092ac1 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.359888 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a1581d60>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.360566 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.360848 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.361167 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] PATH_INFO: `/v3/users` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.361894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.363844 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.383700 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1105/2215] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:31 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:31.387860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.398023 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12846c9-0069-4bc4-93ff-d75081b97bfa admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.403028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a17ee580>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.403670 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.403948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.404218 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.404935 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.406534 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.424711 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1111/2216] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 13 12:56:31.424920 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.433292 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e15b6b-9a93-449c-835a-4081af66a046 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.437941 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a14d7e20>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.438806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.439089 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.439364 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] PATH_INFO: `/v3/projects/861eba6b46944012b1e03239e00ccfa8/users/67cd6e71784645b1bf29a08c3f54ef57/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.453620 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=861eba6b46944012b1e03239e00ccfa8, user_id=67cd6e71784645b1bf29a08c3f54ef57, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.456285 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.469290 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1106/2217] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:31 2022] PUT /identity/v3/projects/861eba6b46944012b1e03239e00ccfa8/users/67cd6e71784645b1bf29a08c3f54ef57/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:31.473503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.484118 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b7003-0b4e-46db-9653-2416848ea097 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.541128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92500508-b28b-44e6-abeb-d3623e4bccec admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a15be3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.541794 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92500508-b28b-44e6-abeb-d3623e4bccec admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.542072 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92500508-b28b-44e6-abeb-d3623e4bccec admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.542342 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92500508-b28b-44e6-abeb-d3623e4bccec admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.543060 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92500508-b28b-44e6-abeb-d3623e4bccec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.544637 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92500508-b28b-44e6-abeb-d3623e4bccec admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.554737 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1112/2218] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:31.558849 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.569183 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515ac38-35ab-4968-99a7-0c2af596af35 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.573885 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a15174c0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.574789 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.575071 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.575348 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] PATH_INFO: `/v3/projects/861eba6b46944012b1e03239e00ccfa8/users/67cd6e71784645b1bf29a08c3f54ef57/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.577496 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=861eba6b46944012b1e03239e00ccfa8, user_id=67cd6e71784645b1bf29a08c3f54ef57, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.580219 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.591061 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1107/2219] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:31 2022] PUT /identity/v3/projects/861eba6b46944012b1e03239e00ccfa8/users/67cd6e71784645b1bf29a08c3f54ef57/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:31.601611 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.601900 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.602174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.628246 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] MFA Rules not processed for user `67cd6e71784645b1bf29a08c3f54ef57`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:31.629544 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:31.701852 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1113/2220] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:31.713586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:31.715428 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:31.773735 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206740a-e449-4018-83b8-68a91b3353ed admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:31.777534 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1680b05-b82a-4159-8f11-437d89bcbc6b service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a11c0970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:31.778516 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680b05-b82a-4159-8f11-437d89bcbc6b service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:31.778855 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680b05-b82a-4159-8f11-437d89bcbc6b service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:31.779193 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1680b05-b82a-4159-8f11-437d89bcbc6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:31.789359 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1680b05-b82a-4159-8f11-437d89bcbc6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:31.790805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1680b05-b82a-4159-8f11-437d89bcbc6b service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:31.800151 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1108/2221] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:32.157174 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:32.219773 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3525401-7c92-4887-9f2e-c9a55ebb9a7d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:32.225119 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a15be7f0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:32.225961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:32.226232 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:32.226576 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] PATH_INFO: `/v3/users/62debe8fba3542948d95387f9b178b70` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:32.227754 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62debe8fba3542948d95387f9b178b70)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:32.230433 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:32.275191 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62debe8fba3542948d95387f9b178b70'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.275860 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62debe8fba3542948d95387f9b178b70'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.276443 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62debe8fba3542948d95387f9b178b70'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.289594 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62debe8fba3542948d95387f9b178b70'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.296269 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62debe8fba3542948d95387f9b178b70'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.308280 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1114/2222] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:32 2022] DELETE /identity/v3/users/62debe8fba3542948d95387f9b178b70 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:32.312877 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:32.313197 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:32.313475 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:32.330942 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:32.332163 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:32.391226 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1109/2223] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:32.401104 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:32.402499 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:32.461558 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e563e6-e8b2-4537-8091-cb81de44dcb6 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:32.465221 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] RBAC: auth_context: {'token': <TokenModel (audit_id=j6FK3pPORB2RW3QprnJFGg, audit_chain_id=['j6FK3pPORB2RW3QprnJFGg']) at 0x7fe8a14e2e80>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40efb0126116472aabce8459ff59bae0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:32.465863 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:32.466143 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:32.466416 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:32.476278 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:32.477792 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:32.487198 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1115/2224] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:32.794749 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:32.796507 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:32.814879 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba0eb-f947-4d5c-8c7b-ce0e5050005e None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:32.821230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a1556d00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:32.823039 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:32.823388 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:32.824150 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] PATH_INFO: `/v3/projects/b8b3ae633e684497b8c76093579a662e` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:32.827600 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b3ae633e684497b8c76093579a662e)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:32.831296 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:32.893639 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b3ae633e684497b8c76093579a662e', 'request_id': 'req-99e730ab-4750-42df-9c5c-313efdaf2e92'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.910961 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b3ae633e684497b8c76093579a662e', 'request_id': 'req-99e730ab-4750-42df-9c5c-313efdaf2e92'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.920611 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b3ae633e684497b8c76093579a662e', 'request_id': 'req-99e730ab-4750-42df-9c5c-313efdaf2e92'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.935004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] The token cache is being invalidate because project b8b3ae633e684497b8c76093579a662e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:32.935377 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.936257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:32.943198 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1110/2225] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:32 2022] DELETE /identity/v3/projects/b8b3ae633e684497b8c76093579a662e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:32.950328 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:32.963242 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff11eec-ea72-4e37-a5b8-774663374fd9 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.040456 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a0fd3370>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.041363 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.041643 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.041966 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] PATH_INFO: `/v3/users/67cd6e71784645b1bf29a08c3f54ef57` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.043217 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67cd6e71784645b1bf29a08c3f54ef57)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.045128 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.096209 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67cd6e71784645b1bf29a08c3f54ef57'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.096851 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67cd6e71784645b1bf29a08c3f54ef57'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.097469 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67cd6e71784645b1bf29a08c3f54ef57'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.109808 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67cd6e71784645b1bf29a08c3f54ef57'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.117166 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0e741e0c-bf49-4fbb-8771-747364ddedf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67cd6e71784645b1bf29a08c3f54ef57'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.128934 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1116/2226] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:32 2022] DELETE /identity/v3/users/67cd6e71784645b1bf29a08c3f54ef57 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:33.397004 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.398492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:33.417527 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e730ab-4750-42df-9c5c-313efdaf2e92 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.475361 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=NcNJxJ8dRPSpabQCX91IQQ, audit_chain_id=['NcNJxJ8dRPSpabQCX91IQQ']) at 0x7fe8a1464970>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.476212 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.476492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.476756 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] PATH_INFO: `/v3/projects/861eba6b46944012b1e03239e00ccfa8` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.477968 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=861eba6b46944012b1e03239e00ccfa8)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.479868 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.525349 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '861eba6b46944012b1e03239e00ccfa8', 'request_id': 'req-089e5b36-d75d-4405-8178-a4c028072af3'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.533033 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '861eba6b46944012b1e03239e00ccfa8', 'request_id': 'req-089e5b36-d75d-4405-8178-a4c028072af3'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.539240 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '861eba6b46944012b1e03239e00ccfa8', 'request_id': 'req-089e5b36-d75d-4405-8178-a4c028072af3'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.551118 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] The token cache is being invalidate because project 861eba6b46944012b1e03239e00ccfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86344) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 13 12:56:33.551409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.552806 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-089e5b36-d75d-4405-8178-a4c028072af3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:33.554577 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1111/2227] 10.222.0.49 () {58 vars in 1232 bytes} [Fri May 13 12:56:33 2022] DELETE /identity/v3/projects/861eba6b46944012b1e03239e00ccfa8 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:33.559488 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.559947 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.560078 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.588162 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:33.589398 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:33.646751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1117/2228] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:33.654836 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.655129 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.655409 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.673829 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:33.675020 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:33.683802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1112/2229] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:33.687908 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.697503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b83129-1d2c-4fb5-b66d-b36108dadf2f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.702042 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a0f9fbe0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.702682 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.702964 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.703239 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.703958 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 13 12:56:33.704262 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.705894 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.717295 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1118/2230] 10.222.0.49 () {58 vars in 1152 bytes} [Fri May 13 12:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 13 12:56:33.721673 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.731629 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a0285-b3f0-4fdb-afb9-de0dfa6e53e2 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.736405 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a109a8e0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.737085 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.737369 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.737642 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.738326 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.741056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.765230 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1113/2231] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:33 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:33.769362 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.779853 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a455e95-f6fc-4854-8f4a-facfb0a5f3d3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.835537 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a133c3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.836201 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.836474 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.836742 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.837467 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.839349 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.858978 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1119/2232] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:33 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:56:33.863392 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.874484 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f9913-8ad7-4ae3-af3e-8120f6fa8e59 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.879395 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a15860a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.880126 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.880433 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.880775 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.881543 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.883137 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.893751 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1114/2233] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:33.898406 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.909114 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3deadbd-3e1c-4e18-8aa4-abf3ae65f11d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.915214 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0035858-5fda-4735-b1ce-2e373a2dc88d admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a1429af0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.915873 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0035858-5fda-4735-b1ce-2e373a2dc88d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.916157 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0035858-5fda-4735-b1ce-2e373a2dc88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.916437 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0035858-5fda-4735-b1ce-2e373a2dc88d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.917322 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0035858-5fda-4735-b1ce-2e373a2dc88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.918952 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0035858-5fda-4735-b1ce-2e373a2dc88d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.930097 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1120/2234] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:33.934223 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:33.944238 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d24a4a-6f18-4a7b-b639-20c0cf0844ae admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:33.948954 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a1046fa0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:33.949871 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] REQUEST_METHOD: `PUT` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.950592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.950592 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] PATH_INFO: `/v3/projects/228804100891481ca82b29e37cf2f916/users/6362a0a64ca34b588807114560488ed2/roles/fa930edb07634faa8c2c98410f8403d6` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:33.967216 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=228804100891481ca82b29e37cf2f916, user_id=6362a0a64ca34b588807114560488ed2, role_id=fa930edb07634faa8c2c98410f8403d6)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:33.970257 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:33.985215 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1115/2235] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:33 2022] PUT /identity/v3/projects/228804100891481ca82b29e37cf2f916/users/6362a0a64ca34b588807114560488ed2/roles/fa930edb07634faa8c2c98410f8403d6 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:33.996888 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:33.997220 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:33.997498 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.024297 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] MFA Rules not processed for user `6362a0a64ca34b588807114560488ed2`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:34.025540 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:34.117289 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1121/2236] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:34.122161 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.191582 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa983af-0d62-4c68-9e8c-421a6d7dda01 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.202217 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a15310d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.202883 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.203166 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.203441 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.204144 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.206056 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.231952 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1116/2237] 10.222.0.49 () {60 vars in 1152 bytes} [Fri May 13 12:56:34 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 13 12:56:34.235752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.247275 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28363fb0-d5eb-4777-90ae-1e40b1d69786 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.305746 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a14e1a00>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.306413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.306690 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.306961 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.307669 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.309614 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.329533 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1122/2238] 10.222.0.49 () {60 vars in 1143 bytes} [Fri May 13 12:56:34 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 13 12:56:34.333524 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.343802 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48111731-1841-4b01-9ddf-0503bfc478e0 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.348402 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a1528850>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.349652 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.349937 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.350222 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.350951 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.352598 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.363036 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1117/2239] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:34.367751 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.379438 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7e9d30-6bad-4ead-93b8-6c5e7737602e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.384686 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a15be3d0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.385600 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.385876 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.386149 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] PATH_INFO: `/v3/projects/00fe357eaa874151a11f3d598f1aa5db/users/3b031d23a2004e9fb1e3e04b0713ee8c/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.403396 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe357eaa874151a11f3d598f1aa5db, user_id=3b031d23a2004e9fb1e3e04b0713ee8c, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.406028 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.421390 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1123/2240] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:34 2022] PUT /identity/v3/projects/00fe357eaa874151a11f3d598f1aa5db/users/3b031d23a2004e9fb1e3e04b0713ee8c/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:56:34.425532 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.436403 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0d9a6-f6ba-4b7c-985d-5fd323011063 admin admin] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.496816 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474b1a2-bb80-47b0-8471-a4b53279a890 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a1604070>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.498200 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b1a2-bb80-47b0-8471-a4b53279a890 admin admin] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.498200 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b1a2-bb80-47b0-8471-a4b53279a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.498605 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474b1a2-bb80-47b0-8471-a4b53279a890 admin admin] PATH_INFO: `/v3/roles` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.499587 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b1a2-bb80-47b0-8471-a4b53279a890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.501822 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474b1a2-bb80-47b0-8471-a4b53279a890 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.513641 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1118/2241] 10.222.0.49 () {58 vars in 1121 bytes} [Fri May 13 12:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 13 12:56:34.518264 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.530752 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d45736c-8375-4d93-9a32-8c1ae7617690 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.536948 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a182e940>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.538093 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.538503 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.538783 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] PATH_INFO: `/v3/projects/00fe357eaa874151a11f3d598f1aa5db/users/3b031d23a2004e9fb1e3e04b0713ee8c/roles/b40b60e4a9ee43fda91654b1667cba2a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.540930 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe357eaa874151a11f3d598f1aa5db, user_id=3b031d23a2004e9fb1e3e04b0713ee8c, role_id=b40b60e4a9ee43fda91654b1667cba2a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.543927 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.555324 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1124/2242] 10.222.0.49 () {60 vars in 1482 bytes} [Fri May 13 12:56:34 2022] PUT /identity/v3/projects/00fe357eaa874151a11f3d598f1aa5db/users/3b031d23a2004e9fb1e3e04b0713ee8c/roles/b40b60e4a9ee43fda91654b1667cba2a => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 13 12:56:34.565586 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] REQUEST_METHOD: `POST` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.565873 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.566148 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.592953 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.auth.core [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] MFA Rules not processed for user `3b031d23a2004e9fb1e3e04b0713ee8c`. Rule list: `[]` (Enabled: `True`). {{(pid=86344) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:34.594229 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.fernet_utils [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86344) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:34.663207 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1119/2243] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 13 12:56:34.674063 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:34.675787 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:34.734291 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742be86-3f5c-4ba4-9c6e-e67adf12dad9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:34.737889 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ce02a-8885-40d4-bf4d-a138bafd3724 service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a150a760>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:34.738525 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce02a-8885-40d4-bf4d-a138bafd3724 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:34.738804 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce02a-8885-40d4-bf4d-a138bafd3724 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:34.739075 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ce02a-8885-40d4-bf4d-a138bafd3724 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:34.795715 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ce02a-8885-40d4-bf4d-a138bafd3724 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:34.797195 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ce02a-8885-40d4-bf4d-a138bafd3724 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:34.806652 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1125/2244] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:39.042608 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:39.054572 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df2f97-f232-46c1-97e9-a0789d9ccc40 None None] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:39.058258 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] RBAC: auth_context: {'token': <TokenModel (audit_id=wTI_qvjaRlum-QHEeHXDgQ, audit_chain_id=['wTI_qvjaRlum-QHEeHXDgQ']) at 0x7fe8a1d6cc10>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eada5adaf6724be28208b8c7b0110e5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0612cc0f32c14b0ab7f07ed29011e61c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:39.058894 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] REQUEST_METHOD: `GET` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:39.059175 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:39.059448 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:39.070414 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:39.071865 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:39.081876 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1120/2245] 10.222.0.49 () {60 vars in 1365 bytes} [Fri May 13 12:56:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 13 12:56:42.812801 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd87b-9468-4753-b977-14799d6ad024 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:42.813299 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd87b-9468-4753-b977-14799d6ad024 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:42.813413 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024dd87b-9468-4753-b977-14799d6ad024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:42.832604 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-024dd87b-9468-4753-b977-14799d6ad024 None None] MFA Rules not processed for user `b8c8941361fb4800ad0574237c9ac377`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:42.834136 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-024dd87b-9468-4753-b977-14799d6ad024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:42.891674 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1126/2246] 10.222.0.49 () {58 vars in 957 bytes} [Fri May 13 12:56:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 13 12:56:44.191704 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] Authenticating user token {{(pid=86344) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 13 12:56:44.257352 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca33552-9d77-4ddb-beb1-5b50305f9aca service cinder] Validating token access rules against request {{(pid=86344) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 13 12:56:44.262805 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] RBAC: auth_context: {'token': <TokenModel (audit_id=wE9wEmbvQLuzS6mVnHtM2A, audit_chain_id=['wE9wEmbvQLuzS6mVnHtM2A']) at 0x7fe8a15ff6a0>, 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94afba6895414851b5641f8db5e9fdde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1a91e56fe3d748728a2efec64d71ac50', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86344) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 13 12:56:44.263712 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:44.263976 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:44.264248 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] PATH_INFO: `/v3/users/6362a0a64ca34b588807114560488ed2` {{(pid=86344) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:44.265492 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6362a0a64ca34b588807114560488ed2)` {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 13 12:56:44.267427 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] RBAC: Authorization granted {{(pid=86344) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 13 12:56:44.325881 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6362a0a64ca34b588807114560488ed2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:44.326320 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6362a0a64ca34b588807114560488ed2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:44.326932 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6362a0a64ca34b588807114560488ed2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:44.340753 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6362a0a64ca34b588807114560488ed2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:44.348345 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: DEBUG keystone.notifications [None req-646fdf8f-0cac-4d52-ad3a-251f504bb379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6362a0a64ca34b588807114560488ed2'} {{(pid=86344) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 13 12:56:44.361513 dv-cinder-841644-1-iscsi devstack@keystone.service[86344]: [pid: 86344|app: 0|req: 1121/2247] 10.222.0.49 () {58 vars in 1223 bytes} [Fri May 13 12:56:44 2022] DELETE /identity/v3/users/6362a0a64ca34b588807114560488ed2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 13 12:56:44.366382 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484de0b-5461-4e8b-b8c5-d7ede414a0d9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 13 12:56:44.366835 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484de0b-5461-4e8b-b8c5-d7ede414a0d9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 13 12:56:44.366944 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7484de0b-5461-4e8b-b8c5-d7ede414a0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 13 12:56:44.385103 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7484de0b-5461-4e8b-b8c5-d7ede414a0d9 None None] MFA Rules not processed for user `94afba6895414851b5641f8db5e9fdde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 13 12:56:44.386684 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7484de0b-5461-4e8b-b8c5-d7ede414a0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 13 12:56:44.457923 dv-cinder-841644-1-iscsi devstack@keystone.service[86345]: [pid: 86345|app: